Splunk and AWS: Monitoring & Metrics in a Serverless World

Bill Bartlett (fellow Splunker) and I have recently had the distinct pleasure of moving some workloads from AWS EC2 over to a combo of AWS Lambda and AWS API Gateway. Between the dramatic cost savings, and wonderful experience of not managing a server, making this move was a no brainer (facilitated as well by great frameworks like Zappa). Both services are pretty robust, and while perhaps not perfect, to us they are a beautiful thing.

While we were using Splunk to monitor several EC2 servers with various bits of custom code via the Splunk App and Add-On for AWS, we realized (ex post facto) that while Lambda was supported out of the box by the Add-On, API Gateway was …

» Continue reading

Head in the Cloud? Maximize your Operational Intelligence with Even Deeper Integration Between Splunk and AWS

Even more exciting news from re:invent!

In case you weren’t watching the live-stream of the event, you may have missed the keynote announcement this morning about the new service called AWS Personal Health.

Splunk’s integration with AWS Personal Health allows AWS customers to proactively monitor over 70 services and quickly act on personal service interruptions informing their users of things like reserved instance retirement, network issues, even instance failures. Before, if there was a network issue, your only way of knowing was based on regional or availability zone messaging. This integration brings an even more personalized experience to using Splunk for monitoring and managing your mission critical workloads in AWS.

The AWS Health API delivers critical data on AWS service quality and …

» Continue reading

AWS Operational, Security and Cost Management Insights Starting at $3/day

LGO-Splunk-Light-CMYK-KThanksgiving is over and we now enter the gift-giving season and Splunk has something that you can both be thankful for as well as a little gift for you (just make sure you read to the end).  First, what you can be thankful for – you can now get full visibility into your AWS environments starting at just $3/day with the new combination of Splunk Light and the Splunk App for AWS 5.0.

Let’s face it, if you use Amazon Web Services (AWS) you use it for a few key reasons:

  • Ease of deployment and ongoing maintenance
  • On-demand flexibility
  • Lower total cost of ownership than an on-premise environment

With all of that you also get a ton of information …

» Continue reading

Announcing new AWS Lambda Blueprints for Splunk

Splunk and Amazon Web Services (AWS) are continuously collaborating to drive customer success by leveraging both the agility of AWS, and the visibility provided by Splunk. To support that goal, we’re happy to announce new AWS Lambda blueprints to easily stream valuable logs, events and alerts from over 15 AWS services into Splunk to help customers gain critical security and operational insights.
splunk_lambda_mediumWith a point-and-click setup, you can use these blueprints to have Splunk ingest data from AWS services such as Kinesis Stream, CloudWatch Logs, DynamoDB Stream and IoT for further data processing & analytics in addition to logging AWS Lambda itself for instrumentation & troubleshooting.

Once Lambda blueprint is configured, events are automatically forwarded in near real-time by Lambda onto Splunk

» Continue reading

Cloud, Automation and Continuous Delivery to Headline DevOps Day at AWS re:Invent 2016

Learn all about Splunk at AWS re:Invent 2016.

reinvent-logo-2x-centeredDevOps, cloud, automation, continuous delivery and integration fans, it is going to be a busy week at AWS re:Invent2016! Splunk will be there, and we invite you to join us for many fun and exciting activities including telling Amazon Alexa to run your Splunk searches.

DevOps at Splunk Booth (#106)

Whether you are new to DevOps or already continuously releasing in the cloud, come and chat with our experts to learn how Splunk analytics and correlated insights across your continuous delivery(CD) pipeline can help you release faster. We will showcase DevOps integrations including new Real-Time JIRA Service Desk Connector for Splunk, Puppet Enterprise App for Splunk, Splunk App for Jenkins, or using …

» Continue reading

How to: Splunk Analytics for Hadoop on Amazon EMR.

Using Amazon EMR and Splunk Analytics for Hadoop to explore, analyze and visualize machine data

Machine data can take many forms and comes from a variety of sources; system logs, application logs, service and system metrics, sensors data etc. In this step-by-step guide, you will learn how to build a big data solution for fast, interactive analysis of data stored in Amazon S3 or Hadoop. This hands-on guide is useful for solution architects, data analysts and developers.

This guide will see you:

  1. Setup an EMR cluster
  2. Setup a Splunk Analytics for Hadoop node
  3. Connect to data in your S3 buckets
  4. Explore, visualize and report on your data

You will need:

  1. An Amazon EMR Cluster
  2. A Splunk Analytics for Hadoop Instance
  3. Amazon
» Continue reading

Countdown to AWS re:Invent — Looking for Real-time AWS Cost Management?

Learn all about Splunk at AWS re:Invent 2016.

reinvent-logo-2x-centeredThe conclusion of .conf2016 means one thing for the cloud team here at Splunk –  time to prepare for AWS re:Invent. We’re just a month away, so let me welcome you to the first post of a re:Invent preview series about how AWS agility + Splunk visibility = customer success.

This week’s topic is a throwback to my presentation last year with Gary Mikula and Siddhartha Dadana of FINRA – talking about end-to-end visibility in a large-scale AWS environment – particularly with regard to cost management.

If you use AWS, you know the challenges with managing cost. Your developers spin up instances and forget to spin them down.  You leverage on-demand instances …

» Continue reading

You Bet Your Sweet SaaS, AWS will be at #splunkconf16!

The following is a guest blog post by David Potes, AWS Solutions Architect:

SCL-Splunk-conf2016-preview-BigDataIdeas_twtr1-440x220The end of September is one of my favorite times of the year, and not just because it’s finally Summer in San Francisco. It’s the time we attend Splunk .conf to talk about all of the things you can do with Amazon Web Services (AWS) and Splunk.

Here are a few .conf sessions highlighting the strong partnership between AWS and Splunk:

» Continue reading

Talk to Splunk with Amazon Alexa

What do you think the future experience of interacting with your data is going to be like ? Is it going to be logging in by way of a user interface and then using your mouse/keyboard/gestures to view and interact with something on a display panel , or is it going to be more like simply talking with another person ?

Introducing the “Talk to Splunk with Amazon Alexa” App

This is a Splunk App that enables your Splunk instance for interfacing with Amazon Alexa by way of a custom Alexa skill, thereby provisioning a Natural Language interface for Splunk.

You can then use an Alexa device such as Amazon’s Echo,Tap or Dot or another 3rd party hardware device to tell …

» Continue reading

AWS Agility + Splunk Visibility = Customer Success

If you’ve ever wondered how Splunk and AWS work together to drive customer success in the cloud, hear it directly from AWS CEO Andy Jassy and Splunk CEO Doug Merritt in this new 4-minute video:

What’s best is that this message is not just coming from Andy and Doug – so many of our joint customers have publicly shared the value they gain using Splunk and AWS together:

  • Autodesk has gained critical security and operational insights.
  • Coca-Cola North America engaged in a digital marketing transformation.
  • EnerNOC succeeded with DevOps on AWS.
  • FINRA gained security and operational insights, as well as real-time cost management where they are saving over 50% on select AWS workloads.

Screen Shot 2016-06-22 at 8.46.02 AMWhat’s our “secret sauce”?  It’s simple… customer

» Continue reading