An AWS Summer: Part 2

LGO-conf2015-RGBBefore our Summer ends we wanted to be sure everyone had a sneak peek into what Autumn will bring next week @ Splunk .conf15 in Las Vegas!

Amazon Web Services (AWS) is a .conf15 Tera sponsor so be sure and visit their booth throughout the week.
The new Splunk App for AWS will be on display!

In addition, we have a great line up of breakout sessions focused on AWS & Cloud. Have a look at what’s on the agenda for AWS & keep an eye out for additional Cloud-focused sessions:

Tuesday, 9/22

Cloud Super Session: How Splunk can help you succeed in the cloud

FINRA: Leveraging Splunk to Manage your AWS Environment

Hunk and Elastic Map …

» Continue reading

An AWS Summer: Part 1

Screen Shot 2015-08-04 at 3.06.39 PMAWS Summit season has come to a close. San Francisco. London. Sydney. Paris. Berlin. Amsterdam. Chicago. New York… the list goes on! Splunk had the opportunity to participate in 12 cities worldwide!

What did we learn?

AWS continues to invent and innovate, announcing new services for budgeting & forecasting, building server-less applications, deploying and managing APIs, VPC flow capture, and intuitive machine learning.

It is clear that many of our customers continue to invest in AWS as a priority IT initiative and are using our Splunk for AWS App to help visualize security posture, compliance activity, and AWS resource changes. These projects are no longer part of shadow IT but are transformational programs creating agility and efficiency while reducing the …

» Continue reading

Introducing the new Splunk App for AWS

Today we’re excited to announce the release of a fully re-written and much expanded Splunk App for AWS. Get it here and gain immediate operational assurance and visibility for your AWS-hosted infrastructure.

What’s new with the app?

  •  Works with Splunk Add-on for Amazon Web Services
  • New dashboards and visualizations for AWS Cloudtrail
  • New alerts for AWS CloudTrail
  • New dashboards and visualizations for AWS Config
  • Billing Reports provided by Splunk Add-on for Amazon Web Services

AWS CloudTrail
AWS CloudTrail records user API activity and related events for your AWS account. Using the <Splunk Add-on for Amazon Web Services> you can retrieve details about the actions made by the caller, including the caller’s identity, the time of the call, the request …

» Continue reading

Introducing the Hunk App for AWS Elastic Load Balancing

Update 9/27/16: As of Sept. 27, 2016, Hunk functionality has been incorporated into the Splunk Analytics for Hadoop Add-On and Splunk Enterprise versions 6.5 and later.

Today we’re excited to announce the addition of a new member in the class of apps that integrate with the Amazon Web Services ecosystem: Hunk App for AWS Elastic Load Balancing. Other apps in the class include the Splunk App for AWS that collects, reports and visualizes data from AWS CloudTrail and the AWS Billing App that helps you gain greater visibility and assurance in managing your AWS-hosted infrastructure.

What is AWS Elastic Load Balancing? In Amazon’s own words,

ELB is an AWS product that automatically distributes incoming application traffic across multiple Amazon

» Continue reading

Analyze Data with Hunk on Amazon EMR

In this post you will learn how to use Hunk to process data with an Amazon EMR cluster. We will go through the steps of:

  1. Creating a Hunk EC2 instance,
  2. Creating an Amazon EMR cluster
  3. Configure Hunk with EMR for the purposes of analyzing data in an S3 bucket.

** SECURITY NOTE** Before we start, a quick but very important note about network security You need to make sure that the Hunk instance can freely communicate (i.e. traffic allowed to and from all ports) with ALL EMR cluster nodes; master and slaves. Please edit Security Groups in EC2 Management page to account for this requirement.

Create a Hunk instance on AWS EC2.

The most convenient way to create an …

» Continue reading

Two time-series, One Chart – Part Two

Following up on to my last post about plotting two time-series in one chart, I would like to talk about another related, larger topic; plotting multiple time-series on a single chart using a single search. Take for example the case of measuring and comparing values of a certain metric over multiple time ranges that are not adjacent to each other (as opposed to the last post were both series were adjacent; current hour vs. last hour, today vs. yesterday etc.)

Assume that in this example the metric of interest is average(responseTime) of a particular service that you’re offering. Further, assume that we would like to measure it over the last hour and compare it to the maximum of the …

» Continue reading

Two time-series, One Chart (and One Search)

Plotting two time-series in a single chart is a question often asked by many of our customers and Answers users. Admittedly, given the many ways to manipulate data, there are several methods to achieve this [1]. Most of them frequently use two searches – a main search and a subsearch with append – to pull target data over the adjacent timeranges that we’re interested on. Then, the _time field is manipulated to overlay both time graphs. While there is nothing wrong with this method, it is typically more efficient to use a single search instead.

I have created and I am sharing three macros to facilitate this. They paint two time-series graphs by using one search while manipulating the _time …

» Continue reading