Splunk AWS Quick Start: Deploy Your AWS Splunk Environment In Minutes

If I told you that a fully operational Splunk Enterprise deployment in AWS could be yours in a matter of minutes, would you be interested? Sit down, relax, and I’ll tell you all you need to know to have a Splunk Enterprise deployment ready to index; fully configured with indexer replication and search head clustering in less than an hour.

Late last year, I wrote a deployment guide for Splunk Enterprise on AWS that explains your options when deploying Splunk Enterprise in AWS. Today, it gets better: I’m happy to report that document has been expanded upon, and Splunk has released an official Splunk Enterprise AWS Quick Start.

If you’re not familiar with AWS Quick Start, the underlying …

» Continue reading

How to stream AWS CloudWatch Logs to Splunk (Hint: it’s easier than you think)

At AWS re:Invent 2016, Splunk released several AWS Lambda blueprints to help you stream logs, events and alerts from more than 15 AWS services into Splunk to gain enhanced critical security and operational insights into your AWS infrastructure & applications. In this blog post, we’ll walk you through step-by-step how to use one of these AWS Lambda blueprints, the Lambda blueprint for CloudWatch Logs, to stream AWS CloudWatch Logs via AWS Lambda and into Splunk for near real-time analysis and visualization as depicted in the diagram below. In the following example, we are interested in streaming VPC Flow logs which are stored in CloudWatch Logs. VPC Flow logs capture information about all the IP traffic going to and from …

» Continue reading

It’s cloudy in London. Monitoring workloads in the AWS London Region with Splunk.

LondonClouds

Hi everyone, Happy New Year (is it too late to be still saying that?) I’m currently sat in Splunk’s London office just behind Paddington train station and to no ones surprise it’s cloudy. Clouds aren’t anything new to London, but just before Christmas, AWS launched its new Europe (London) Region.

Following on from the new region launch, I’m happy to announce the latest update to the Splunk App for AWS. This update (5.0.1) now gives support for the AWS London Region. This means that if you’re monitoring your AWS workloads (be that globally, EMEA-wide or just in the UK) you can now use machine data from the UK region to get Operational Intelligence and real-time visibility. The app is …

» Continue reading

Splunk and AWS: Monitoring & Metrics in a Serverless World

Bill Bartlett (fellow Splunker) and I have recently had the distinct pleasure of moving some workloads from AWS EC2 over to a combo of AWS Lambda and AWS API Gateway. Between the dramatic cost savings, and wonderful experience of not managing a server, making this move was a no brainer (facilitated as well by great frameworks like Zappa). Both services are pretty robust, and while perhaps not perfect, to us they are a beautiful thing.

While we were using Splunk to monitor several EC2 servers with various bits of custom code via the Splunk App and Add-On for AWS, we realized (ex post facto) that while Lambda was supported out of the box by the Add-On, API Gateway was …

» Continue reading

Head in the Cloud? Maximize your Operational Intelligence with Even Deeper Integration Between Splunk and AWS

Even more exciting news from re:invent!

In case you weren’t watching the live-stream of the event, you may have missed the keynote announcement this morning about the new service called AWS Personal Health.

Splunk’s integration with AWS Personal Health allows AWS customers to proactively monitor over 70 services and quickly act on personal service interruptions informing their users of things like reserved instance retirement, network issues, even instance failures. Before, if there was a network issue, your only way of knowing was based on regional or availability zone messaging. This integration brings an even more personalized experience to using Splunk for monitoring and managing your mission critical workloads in AWS.

The AWS Health API delivers critical data on AWS service quality and …

» Continue reading

AWS Operational, Security and Cost Management Insights Starting at $3/day

LGO-Splunk-Light-CMYK-KThanksgiving is over and we now enter the gift-giving season and Splunk has something that you can both be thankful for as well as a little gift for you (just make sure you read to the end).  First, what you can be thankful for – you can now get full visibility into your AWS environments starting at just $3/day with the new combination of Splunk Light and the Splunk App for AWS 5.0.

Let’s face it, if you use Amazon Web Services (AWS) you use it for a few key reasons:

  • Ease of deployment and ongoing maintenance
  • On-demand flexibility
  • Lower total cost of ownership than an on-premise environment

With all of that you also get a ton of information …

» Continue reading

Announcing new AWS Lambda Blueprints for Splunk

Splunk and Amazon Web Services (AWS) are continuously collaborating to drive customer success by leveraging both the agility of AWS, and the visibility provided by Splunk. To support that goal, we’re happy to announce new AWS Lambda blueprints to easily stream valuable logs, events and alerts from over 15 AWS services into Splunk to help customers gain critical security and operational insights.
splunk_lambda_mediumWith a point-and-click setup, you can use these blueprints to have Splunk ingest data from AWS services such as Kinesis Stream, CloudWatch Logs, DynamoDB Stream and IoT for further data processing & analytics in addition to logging AWS Lambda itself for instrumentation & troubleshooting.

Once Lambda blueprint is configured, events are automatically forwarded in near real-time by Lambda onto Splunk

» Continue reading

Cloud, Automation and Continuous Delivery to Headline DevOps Day at AWS re:Invent 2016

Learn all about Splunk at AWS re:Invent 2016.

reinvent-logo-2x-centeredDevOps, cloud, automation, continuous delivery and integration fans, it is going to be a busy week at AWS re:Invent2016! Splunk will be there, and we invite you to join us for many fun and exciting activities including telling Amazon Alexa to run your Splunk searches.

DevOps at Splunk Booth (#106)

Whether you are new to DevOps or already continuously releasing in the cloud, come and chat with our experts to learn how Splunk analytics and correlated insights across your continuous delivery(CD) pipeline can help you release faster. We will showcase DevOps integrations including new Real-Time JIRA Service Desk Connector for Splunk, Puppet Enterprise App for Splunk, Splunk App for Jenkins, or using …

» Continue reading

How to: Splunk Analytics for Hadoop on Amazon EMR.

Using Amazon EMR and Splunk Analytics for Hadoop to explore, analyze and visualize machine data

Machine data can take many forms and comes from a variety of sources; system logs, application logs, service and system metrics, sensors data etc. In this step-by-step guide, you will learn how to build a big data solution for fast, interactive analysis of data stored in Amazon S3 or Hadoop. This hands-on guide is useful for solution architects, data analysts and developers.

This guide will see you:

  1. Setup an EMR cluster
  2. Setup a Splunk Analytics for Hadoop node
  3. Connect to data in your S3 buckets
  4. Explore, visualize and report on your data

You will need:

  1. An Amazon EMR Cluster
  2. A Splunk Analytics for Hadoop Instance
  3. Amazon
» Continue reading

Countdown to AWS re:Invent — Looking for Real-time AWS Cost Management?

Learn all about Splunk at AWS re:Invent 2016.

reinvent-logo-2x-centeredThe conclusion of .conf2016 means one thing for the cloud team here at Splunk –  time to prepare for AWS re:Invent. We’re just a month away, so let me welcome you to the first post of a re:Invent preview series about how AWS agility + Splunk visibility = customer success.

This week’s topic is a throwback to my presentation last year with Gary Mikula and Siddhartha Dadana of FINRA – talking about end-to-end visibility in a large-scale AWS environment – particularly with regard to cost management.

If you use AWS, you know the challenges with managing cost. Your developers spin up instances and forget to spin them down.  You leverage on-demand instances …

» Continue reading