Elasticsearch Developer
CACI International
- Virginia
- Permanent
- Full-time
- * *
The Elasticsearch Developer responsibilities include conducting full development lifecycle of data that includes requirements from DHS, other OMB initiatives, and provide support for the whole program. This position also requires building a new data automation practice on the program to address our client’s most pressing needs with Cyber Security Threats and Data. The successful candidate will bring a consultative approach to data to improve the value of the data that’s being collected by our customers. This position is also a thought leader in the practice of Big Data in solving our clients’ cyber security problems, coupled with demonstrated experience designing and developing enterprise data solutions for large clients by providing a new approach to the team, presenting white papers and other solutions.More About the Role:
- Develop and implement scripts in python3 / BASH to interact with the Elasticsearch API to configured indices, visualizations, manipulate existing data, and perform complex search queries
- Develop advanced KQL queries to power visualizations, reports, and other use cases as needed
- Develop dynamic Kibana visualizations to display complex analytics of data stored in elastic indices
- Set up and utilize cross cluster search
- Establish streaming data pipelines using Elastic Beats / Agent on endpoints, fleet server, and elastic integrations
- Develop data reporting methodologies within Elastic Cloud Enterprise to advance CDM functionality and usability within Agency environments
- Develop YAML configuration files for standard elasticsearch and containerized elastic platforms
- Develop code to interact with non-Elastic APIs (i.e. cyber security tools such as Tennable.sc) for purposes of data mining
- Design and implement ELK (ElasticSearch, Logstash and Kibana) stack solutions
- Support Big Data platform build in the cloud
- Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions
- Work with Data and Architect team to understand Data that is generated by multiple tools such as Asset Management, Identity Management, Vulnerability management.
- Develop rules and algorithms for Data processing, transformation, and correlations.
- Work with data stores that support the scalable processing and storage of our high frequency data
- Customize integration tools, warehouses, databases, and analytical systems
- Automate manual processes using Python, BASH, PowerShell, or other scripting language
- Review, Identify, Analyze data from multiple source Cyber Security tools at multiple agencies.
- Interpret data, analyze results using statistical techniques and support data trends based on the customer needs.
- Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality
- Acquire data from primary and other data sources and maintain databases/data systems
- Identify, analyze, and interpret trends or patterns in complex data sets
- Analyze source data and types, identify data requirements for destination systems.
- Analyze, interpret, and develop data models on data based on Data Dictionary & Logical Data Models guidance.
- Locate and define new process improvement opportunities
- Ensure that mapping of data elements provided by COTS products to the Logical Data Model
- Must be a US citizen and pass a background investigation.
- Able to obtain and maintain a DHS Suitability/Entry on Duty (EOD)
- Bachelor's degree complete (or in progress) preferably in applied mathematics, statistics, computer science, data science, electrical engineering, physics, or closely related field
- A minimum of (6) six years of related experience
- Experience with scripting languages like Python, Bash, Powershell, R
- Knowledge of and experience with reporting packages (Business Objects, etc.), databases (SQL, MySql etc.), programming (XML, Javascript, or ETL frameworks)
- Understanding of containerized PaaS platforms such as Azure Kubernetes Service or Elastic Kubernetes Service as well as IaaS hosted platforms such as docker
- Familiarity with the opensource alternatives to licensed Elasticsearch (OpenSearch)
- Proven ability to use multiple REST API authentication types, knowledge of REST methods, and ability to mine APIs to meet data requirements.
- Experience with database query languages like SQL, T-SQL, KQL
- Operating system experience with Linux
- Proficient at queries, report writing and presenting findings.
- Experience collaborating with US Government Agencies, state or local governments, or commercial entities to develop IT service program maturity in accordance with Federal IT mandates and best practices.
- Any related certifications
- Demonstrated ability to investigate data and present findings to internal teammates and client audiences.
- Desired familiarity with the Elastic Cloud Computer (ECE) and Elastic Cloud on Kubernetes (ECK) platforms
- Experience in conducting assessments of an Enterprise by reviewing technical documentation, conducting interviews and workshops to identify gaps and develop a tailored solution is highly desired.