In today’s data-driven world, real-time monitoring and alerting systems are crucial for maintaining the health and performance of systems and applications. One such system is a query-based alerting system that leverages cloud functions and APIs within the Google Cloud Platform (GCP). In this blog, we’ll take a deep dive into how we built a query-based alerting system using GCP’s cloud functions and various APIs.
Understanding the Architecture
Our alerting system operates as a Cloud Scheduler job within GCP, triggered by cron-like scheduling. The core functionality revolves around a cloud function, specifically designed to handle email alerts based on predefined queries and conditions. Let’s break down the key components and steps involved in this process.
1. Query Manager APIs and Cloud Functions
We utilize Query Manager APIs to fetch the necessary cm_ids (client IDs), retrieve system queries, and execute these queries. The cloud function is triggered based on a defined entry point, which matches the function name to be triggered.
2. Integration with SendGrid API
For sending email alerts, we integrate the SendGrid API into our system. The API key required for SendGrid is retrieved from a config file, ensuring secure and authorized access for email communication.
3. Authorization and Security
To authorize the Cloud Scheduler job and ensure security, we implement an authorization header mechanism, adding an extra layer of protection to our system.
4. Query Execution and Data Processing
Initially, we fetch a list of cm_ids using Query Manager APIs. Then, by sending the appropriate tag, we acquire the query ID needed to execute system queries. The execute-query API handles the execution of queries based on the provided query ID, returning the cm_ids obtained from the API.
5. Client Window Times and Interval Management
Client window times, defining the intervals at which queries should run for each client, are stored in Firebase. This information guides the filtering of cm_ids based on these intervals, ensuring efficient query execution.
6. Real-time Processing and Alerting
Based on the defined intervals, we filter cm_ids, retrieve relevant documents from Firestore, and process the data in real-time. The system queries, designed to fetch specific ticket counts over time intervals, are executed for each cm_id. If a ticket count is zero, an email alert is prepared using the SendGrid API and dispatched to the queryalert group.
Conclusion
In conclusion, our query-based alerting system demonstrates the seamless integration of cloud functions, APIs, and external services within the GCP ecosystem. By leveraging Query Manager APIs, SendGrid API, Firebase for interval management, and Firestore for data retrieval, we’ve built a robust and efficient alerting system capable of real-time monitoring and proactive alerting based on predefined queries and conditions.
This architecture not only ensures timely notifications but also provides insights into system performance and trends, enabling proactive decision-making and troubleshooting. As technologies evolve, such systems play a vital role in maintaining the reliability and responsiveness of modern applications and services.
Would you like to delve deeper into any specific aspect or have further questions about our query-based alerting system architecture? Feel free to reach out and continue the conversation!
Solid analysis! Seeing more platforms like boss77 app cater to local payment options like GCash is huge for accessibility here in the Philippines. Makes getting in the game so much easier! 🇵🇭
Heard about 160bet from a buddy. Threw a few bucks on it and actually came out ahead. Not gonna quit my day job, but it was fun. Click here to visit: 160bet
Hey guys, just wanted to shout out helppagebahigo! Found their FAQ super helpful. Seriously saved me a headache. Check it out if you’re on Bahigo and need a hand. helppagebahigo
With havin so much written content do you ever run into any issues of plagorism or copyright violation? My website has a lot of unique content I’ve either authored myself or outsourced but it seems a lot of it is popping it up all over the web without my permission. Do you know any solutions to help stop content from being ripped off? I’d really appreciate it.
Nice read, I just passed this onto a friend who was doing a little research on that. And he actually bought me lunch as I found it for him smile Thus let me rephrase that: Thanks for lunch!
Welcome to S666.com! It is time to have some fun. I hope I get lucky today. Wanna join me? welcome to s666.com
Great blog here! Also your website a lot up very fast! What host are you using? Can I am getting your associate link for your host? I wish my web site loaded up as quickly as yours lol
You are a very clever individual!
Hi there, I found your site via Google while looking for a related topic, your web site came up, it looks great. I have bookmarked it in my google bookmarks.
You are my inhalation, I own few web logs and very sporadically run out from brand :). “Never mistake motion for action.” by Ernest Hemingway.
Very interesting topic, thankyou for putting up. “Challenge is a dragon with a gift in its mouthTame the dragon and the gift is yours.” by Noela Evans.
I have been checking out many of your stories and i must say pretty good stuff. I will make sure to bookmark your blog.
The next time I learn a weblog, I hope that it doesnt disappoint me as much as this one. I imply, I do know it was my choice to read, but I truly thought youd have one thing fascinating to say. All I hear is a bunch of whining about one thing that you could repair in the event you werent too busy looking for attention.
After study a few of the blog posts on your website now, and I truly like your way of blogging. I bookmarked it to my bookmark website list and will be checking back soon. Pls check out my web site as well and let me know what you think.
I like what you guys are up also. Such smart work and reporting! Keep up the excellent works guys I have incorporated you guys to my blogroll. I think it’ll improve the value of my web site 🙂
I likewise think hence, perfectly pent post! .
Thank you for sharing with us, I believe this website genuinely stands out : D.
What i don’t realize is in reality how you are not really much more well-appreciated than you might be right now. You’re so intelligent. You know therefore significantly in terms of this subject, produced me in my view imagine it from a lot of varied angles. Its like men and women aren’t interested unless it¦s one thing to accomplish with Girl gaga! Your own stuffs outstanding. All the time maintain it up!
whoah this blog is excellent i really like studying your articles. Stay up the good work! You already know, many individuals are searching round for this info, you can aid them greatly.
Good day! I could have sworn I’ve been to this site before but after reading through some of the post I realized it’s new to me. Nonetheless, I’m definitely delighted I found it and I’ll be bookmarking and checking back often!
I have been exploring for a little for any high quality articles or blog posts in this kind of space . Exploring in Yahoo I eventually stumbled upon this web site. Studying this info So i am satisfied to convey that I have an incredibly excellent uncanny feeling I came upon just what I needed. I such a lot definitely will make certain to do not forget this web site and give it a look on a relentless basis.
Your place is valueble for me. Thanks!…
As soon as I observed this site I went on reddit to share some of the love with them.
Great tremendous things here. I?¦m very happy to peer your post. Thanks a lot and i’m taking a look forward to touch you. Will you kindly drop me a mail?
Hello there, I found your website via Google while searching for a related topic, your site came up, it looks good. I have bookmarked it in my google bookmarks.
What i don’t realize is if truth be told how you’re not actually a lot more neatly-preferred than you may be right now. You are very intelligent. You already know thus considerably when it comes to this matter, made me for my part imagine it from so many varied angles. Its like men and women aren’t involved unless it is one thing to do with Girl gaga! Your own stuffs outstanding. All the time maintain it up!
I was looking at some of your posts on this website and I conceive this internet site is real instructive! Retain posting.
I cling on to listening to the newscast speak about receiving free online grant applications so I have been looking around for the most excellent site to get one. Could you tell me please, where could i find some?
There are some interesting closing dates on this article but I don’t know if I see all of them center to heart. There is some validity however I will take hold opinion until I look into it further. Good article , thanks and we wish extra! Added to FeedBurner as well
I simply could not leave your web site before suggesting that I actually loved the standard information an individual supply in your guests? Is going to be again frequently in order to inspect new posts.
Good info. Lucky me I reach on your website by accident, I bookmarked it.
You have observed very interesting points! ps nice web site.
I love it when people come together and share opinions, great blog, keep it up.
My programmer is trying to convince me to move to .net from PHP. I have always disliked the idea because of the costs. But he’s tryiong none the less. I’ve been using WordPress on numerous websites for about a year and am concerned about switching to another platform. I have heard great things about blogengine.net. Is there a way I can import all my wordpress posts into it? Any kind of help would be really appreciated!
Wonderful web site. Plenty of helpful info here. I?¦m sending it to some buddies ans additionally sharing in delicious. And naturally, thank you on your sweat!
What i do not realize is in fact how you are no longer really a lot more smartly-favored than you might be now. You are so intelligent. You know thus considerably in terms of this matter, produced me for my part believe it from a lot of numerous angles. Its like women and men are not interested until it is one thing to do with Lady gaga! Your individual stuffs nice. All the time deal with it up!
Some times its a pain in the ass to read what people wrote but this internet site is really user genial! .
Very nice post. I just stumbled upon your weblog and wished to say that I’ve really enjoyed surfing around your blog posts. After all I’ll be subscribing to your rss feed and I hope you write again soon!
Nice post. I used to be checking continuously this weblog and I’m inspired! Very useful information specially the ultimate section 🙂 I maintain such information a lot. I used to be looking for this certain information for a very long time. Thanks and good luck.
I conceive you have noted some very interesting details , regards for the post.
This is a very good tips especially to those new to blogosphere, brief and accurate information… Thanks for sharing this one. A must read article.
Thank you for another wonderful post. Where else could anyone get that type of info in such an ideal way of writing? I’ve a presentation next week, and I am on the look for such information.
I will right away grab your rss feed as I can’t in finding your e-mail subscription link or e-newsletter service. Do you’ve any? Please let me recognize in order that I may subscribe. Thanks.
Undeniably believe that which you stated. Your favorite justification appeared to be on the net the simplest thing to be aware of. I say to you, I definitely get irked while people consider worries that they just do not know about. You managed to hit the nail upon the top and also defined out the whole thing without having side effect , people can take a signal. Will probably be back to get more. Thanks
I like what you guys are up also. Such intelligent work and reporting! Carry on the superb works guys I have incorporated you guys to my blogroll. I think it’ll improve the value of my site :).
I am impressed with this web site, very I am a fan.
Some truly wonderful articles on this site, regards for contribution.
I really appreciate this post. I?¦ve been looking everywhere for this! Thank goodness I found it on Bing. You have made my day! Thx again
Enjoyed studying this, very good stuff, regards. “Love begets love, love knows no rules, this is the same for all.” by Virgil.
Very interesting info !Perfect just what I was looking for!
Hello there, I found your site via Google while searching for a related topic, your site came up, it looks great. I have bookmarked it in my google bookmarks.
Woh I enjoy your blog posts, saved to my bookmarks! .
My spouse and I absolutely love your blog and find most of your post’s to be just what I’m looking for. Would you offer guest writers to write content for yourself? I wouldn’t mind composing a post or elaborating on a few of the subjects you write regarding here. Again, awesome web site!
Its such as you read my thoughts! You appear to understand a lot about this, like you wrote the ebook in it or something. I feel that you just can do with a few p.c. to force the message house a little bit, but instead of that, that is magnificent blog. An excellent read. I’ll certainly be back.
Hey very cool website!! Man .. Beautiful .. Superb .. I will bookmark your blog and take the feeds additionally?KI am satisfied to search out numerous helpful information right here within the submit, we want develop more techniques on this regard, thanks for sharing. . . . . .
Wow that was unusual. I just wrote an extremely long comment but after I clicked submit my comment didn’t show up. Grrrr… well I’m not writing all that over again. Regardless, just wanted to say wonderful blog!
I regard something really special in this website .
I love your blog.. very nice colors & theme. Did you create this website yourself? Plz reply back as I’m looking to create my own blog and would like to know wheere u got this from. thanks
Enjoyed looking at this, very good stuff, thankyou. “Golf isn’t a game, it’s a choice that one makes with one’s life.” by Charles Rosin.
You are a very smart person!
Everyone loves what you guys are up too. This type of clever work and coverage! Keep up the amazing works guys I’ve added you guys to our blogroll.
Hi there! This post could not be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this article to him. Pretty sure he will have a good read. Thanks for sharing!
Thank you for sharing excellent informations. Your web site is very cool. I’m impressed by the details that you have on this site. It reveals how nicely you understand this subject. Bookmarked this website page, will come back for extra articles. You, my pal, ROCK! I found simply the info I already searched all over the place and simply could not come across. What a great web site.
The next time I read a blog, I hope that it doesnt disappoint me as much as this one. I mean, I know it was my option to read, but I actually thought youd have one thing interesting to say. All I hear is a bunch of whining about one thing that you might fix for those who werent too busy looking for attention.
Very nice post. I just stumbled upon your weblog and wanted to say that I have truly enjoyed browsing your blog posts. In any case I will be subscribing to your rss feed and I hope you write again very soon!
Thanks , I’ve just been searching for information about this topic for ages and yours is the greatest I’ve discovered so far. But, what about the conclusion? Are you sure about the source?
Good site! I truly love how it is simple on my eyes and the data are well written. I’m wondering how I could be notified whenever a new post has been made. I have subscribed to your feed which must do the trick! Have a nice day!
Somebody essentially assist to make severely posts I’d state. That is the first time I frequented your web page and thus far? I amazed with the research you made to create this particular put up extraordinary. Excellent task!
You have mentioned very interesting points! ps nice website .
My brother suggested I might like this website. He was entirely right. This post truly made my day. You can not imagine just how much time I had spent for this info! Thanks!
Very good written information. It will be valuable to anybody who utilizes it, including me. Keep doing what you are doing – looking forward to more posts.
It’s really a cool and useful piece of information. I am happy that you simply shared this useful info with us. Please keep us up to date like this. Thank you for sharing.
I know this if off topic but I’m looking into starting my own weblog and was wondering what all is required to get setup? I’m assuming having a blog like yours would cost a pretty penny? I’m not very internet smart so I’m not 100 certain. Any tips or advice would be greatly appreciated. Appreciate it
I have been surfing online more than three hours lately, but I by no means discovered any fascinating article like yours. It is lovely value sufficient for me. Personally, if all web owners and bloggers made excellent content as you did, the web might be a lot more helpful than ever before.
I’ll right away snatch your rss feed as I can not in finding your e-mail subscription hyperlink or e-newsletter service. Do you’ve any? Kindly let me understand in order that I may just subscribe. Thanks.
Thankyou for helping out, superb information.
Saved as a favorite, I really like your blog!
Hello! This post couldn’t be written any better! Reading this post reminds me of my good old room mate! He always kept talking about this. I will forward this page to him. Fairly certain he will have a good read. Many thanks for sharing!
I¦ve been exploring for a little for any high quality articles or weblog posts in this kind of area . Exploring in Yahoo I finally stumbled upon this web site. Reading this information So i¦m glad to show that I have a very just right uncanny feeling I came upon just what I needed. I most for sure will make certain to don¦t put out of your mind this site and give it a look on a relentless basis.
Thank you for helping out, great information. “The health of nations is more important than the wealth of nations.” by Will Durant.
Almost all of whatever you say is supprisingly accurate and that makes me ponder why I had not looked at this in this light previously. This particular piece really did switch the light on for me personally as far as this subject goes. Nonetheless there is actually just one point I am not too cozy with and while I make an effort to reconcile that with the main theme of your position, let me observe just what the rest of your subscribers have to say.Nicely done.
I keep listening to the news update lecture about getting free online grant applications so I have been looking around for the top site to get one. Could you advise me please, where could i get some?
I saw a lot of website but I believe this one has got something extra in it in it
I’m curious to find out what blog system you happen to be utilizing? I’m having some small security problems with my latest website and I’d like to find something more risk-free. Do you have any recommendations?
This really answered my problem, thank you!
I?¦ve been exploring for a little for any high-quality articles or weblog posts in this sort of space . Exploring in Yahoo I ultimately stumbled upon this website. Studying this information So i am satisfied to exhibit that I’ve an incredibly good uncanny feeling I found out exactly what I needed. I such a lot indubitably will make sure to do not omit this web site and provides it a look regularly.
I appreciate, lead to I discovered just what I used to be looking for. You have ended my four day long hunt! God Bless you man. Have a nice day. Bye
I conceive this web site has got some really fantastic information for everyone : D.
Grandpashabet Güvenilir mi? Sounds Turkish, implying “Is Grandpashabet reliable?”. Good question to ask! Look for reviews and see what the community says before using it. Here’s the likely source: grandpashabetguveilirmi
Okevip, eh? Had a quick spin there. Gotta say, the selection ain’t bad. Bonuses seem kinda standard, but hey, free stuff is free stuff. My two cents right here: okevip
Downloaded the 922betapp the other day. Pretty convenient to have it on my phone. Gameplay is smooth and quick. I’d say give it a shot if you prefer mobile gaming: 922betapp
naturally like your web-site however you need to check the spelling on quite a few of your posts. Several of them are rife with spelling problems and I find it very troublesome to tell the reality however I’ll definitely come again again.
Of course, what a splendid blog and educative posts, I surely will bookmark your site.All the Best!
Hi, just required you to know I he added your site to my Google bookmarks due to your layout. But seriously, I believe your internet site has 1 in the freshest theme I??ve came across. It extremely helps make reading your blog significantly easier.
Right now it sounds like Movable Type is the top blogging platform out there right now. (from what I’ve read) Is that what you are using on your blog?
Its wonderful as your other posts : D, regards for putting up.
Only wanna remark on few general things, The website style and design is perfect, the subject material is rattling fantastic. “To establish oneself in the world, one has to do all one can to appear established.” by Francois de La Rochefoucauld.
Thank you for another excellent article. Where else could anyone get that type of information in such an ideal way of writing? I have a presentation next week, and I’m on the look for such information.
I think you have observed some very interesting points, thanks for the post.
I am not sure where you’re getting your info, but great topic. I needs to spend some time learning more or understanding more. Thanks for magnificent information I was looking for this info for my mission.
Nearly all of what you articulate happens to be supprisingly accurate and it makes me wonder the reason why I hadn’t looked at this with this light previously. This article truly did switch the light on for me as far as this specific topic goes. Nonetheless at this time there is one particular point I am not necessarily too cozy with so whilst I try to reconcile that with the actual core theme of the position, allow me observe what the rest of the subscribers have to point out.Well done.
Good – I should certainly pronounce, impressed with your site. I had no trouble navigating through all the tabs and related information ended up being truly simple to do to access. I recently found what I hoped for before you know it at all. Reasonably unusual. Is likely to appreciate it for those who add forums or something, site theme . a tones way for your customer to communicate. Excellent task.
Hi my friend! I wish to say that this article is amazing, nice written and come with approximately all significant infos. I would like to look more posts like this .
Today, I went to the beach front with my children. I found a sea shell and gave it to my 4 year old daughter and said “You can hear the ocean if you put this to your ear.” She placed the shell to her ear and screamed. There was a hermit crab inside and it pinched her ear. She never wants to go back! LoL I know this is entirely off topic but I had to tell someone!
It’s actually a cool and useful piece of information. I am glad that you just shared this helpful info with us. Please stay us informed like this. Thanks for sharing.
You got a very superb website, Glad I found it through yahoo.
I am not sure the place you are getting your info, but good topic. I must spend a while learning more or figuring out more. Thank you for excellent info I was searching for this info for my mission.
Amazing blog! Is your theme custom made or did you download it from somewhere? A theme like yours with a few simple tweeks would really make my blog stand out. Please let me know where you got your design. Bless you
I want looking through and I think this website got some genuinely utilitarian stuff on it! .
Some truly superb information, Glad I observed this.
Those are yours alright! . We at least need to get these people stealing images to start blogging! They probably just did a image search and grabbed them. They look good though!
I got what you mean , regards for putting up.Woh I am pleased to find this website through google. “The test and use of a man’s education is that he finds pleasure in the exercise of his mind.” by Carl Barzun.
I’ve been exploring for a little bit for any high quality articles or blog posts in this sort of house . Exploring in Yahoo I finally stumbled upon this website. Studying this information So i am happy to convey that I have a very excellent uncanny feeling I came upon exactly what I needed. I so much unquestionably will make certain to do not omit this website and give it a look on a continuing basis.
Hello! I’ve been reading your weblog for a while now and finally got the bravery to go ahead and give you a shout out from Atascocita Texas! Just wanted to say keep up the excellent work!
Thanks for sharing excellent informations. Your web site is so cool. I’m impressed by the details that you have on this web site. It reveals how nicely you understand this subject. Bookmarked this web page, will come back for extra articles. You, my friend, ROCK! I found just the info I already searched all over the place and just could not come across. What a great web site.
You actually make it seem so easy with your presentation but I find this matter to be really something that I think I would never understand. It seems too complex and very broad for me. I’m looking forward for your next post, I will try to get the hang of it!
You can definitely see your skills within the work you write. The arena hopes for even more passionate writers like you who aren’t afraid to mention how they believe. All the time go after your heart. “A second wife is hateful to the children of the first a viper is not more hateful.” by Euripides.
You actually make it appear so easy with your presentation however I find this topic to be really something which I think I’d never understand. It sort of feels too complex and extremely vast for me. I’m taking a look ahead on your subsequent put up, I will attempt to get the grasp of it!
As a Newbie, I am always exploring online for articles that can benefit me. Thank you
You have noted very interesting points! ps decent site. “O human race born to fly upward, wherefore at a little wind dost thou fall.” by Dante Alighieri.
I genuinely enjoy reading on this site, it has got superb blog posts.
I just could not go away your site prior to suggesting that I actually enjoyed the standard information an individual supply on your visitors? Is going to be again incessantly in order to check out new posts.
Thank you for sharing with us, I conceive this website really stands out : D.
Have you ever thought about adding a little bit more than just your articles? I mean, what you say is valuable and all. But just imagine if you added some great visuals or video clips to give your posts more, “pop”! Your content is excellent but with images and clips, this blog could undeniably be one of the very best in its field. Terrific blog!
Great website! I am loving it!! Will be back later to read some more. I am bookmarking your feeds also
I got good info from your blog
We’re a bunch of volunteers and starting a new scheme in our community. Your website offered us with valuable information to work on. You have performed an impressive activity and our whole community shall be thankful to you.