Senior Software Engineer (Data Ingestion)

Bengaluru, Karnataka, India
Mar 05, 2025
Mar 05, 2026
Hybrid
Full-Time
2 Years
Job Description

As a Senior Software Engineer, you will be responsible for designing and implementing high-performance data ingestion pipelines that collect, process, and analyze security data from various sources. You will work with modern cloud technologies, leverage AI-driven solutions for optimization, and ensure seamless integration with third-party platforms.

This is a high-impact role where your contributions will directly enhance the capabilities of Microsoft Sentinel, making it more robust and efficient for customers worldwide.

Key Responsibilities

  1. Build and Enhance Data Ingestion Capabilities. Develop high-performance, scalable, and reliable data ingestion pipelines to handle vast amounts of security logs and events.
  2. Innovate and Solve Complex Problems. Design cutting-edge solutions to address challenges in data integration, ensuring seamless and efficient ingestion from diverse sources.
  3. Architect Scalable Systems. Work on petabyte-scale data processing architectures that can ingest and analyze millions of events per second with minimal latency.
  4. Drive Technical Excellence. Implement best practices, coding standards, and modern engineering approaches to improve efficiency and reliability.
  5. Develop Robust Data Connectors. Build top-tier data connectors that integrate with various cloud platforms, enterprise security tools, and log sources.
  6. Utilize AI for Optimization. Explore and implement AI-driven approaches to enhance data ingestion efficiency and automate repetitive processes.
  7. Collaborate Across Teams. Work closely with product managers, security engineers, and cloud infrastructure teams to deliver innovative features.
  8. Support & Troubleshoot Customer Issues. Provide engineering-level support to resolve escalated customer issues related to data ingestion.

Required Qualifications

  • 8+ years of experience in software development with a strong background in C#, .NET, Python, or other relevant programming languages.
  • 2+ years of experience specifically in data ingestion, data integration, or large-scale data processing.
  • Deep understanding of data streaming, batch processing, and real-time analytics.
  • Experience working with cloud platforms like Microsoft Azure, AWS, GCP, or Oracle Cloud Infrastructure (OCI).
  • Strong problem-solving skills and the ability to design highly scalable and efficient architectures.

Preferred Qualifications

  • Hands-on experience with Full Stack Development and building cloud-native applications.
  • Knowledge of SIEM platforms and security log processing.
  • Familiarity with log formats like Syslog, CEF, JSON, or Parquet.
  • Experience implementing AI/ML-based solutions for optimizing data ingestion and analysis.
  • Exposure to distributed computing frameworks such as Apache Kafka, Spark, or Azure Event Hubs.
  • Strong understanding of API development, microservices architecture, and containerization.

Why Join Us?

  • Be part of an industry-leading product team driving next-gen cloud security solutions.
  • Work on complex engineering challenges related to big data, security analytics, and AI-driven automation.
  • Opportunity to influence the future roadmap of Microsoft Sentinel’s data ingestion platform.
  • Enjoy a collaborative and innovation-driven work environment at Microsoft.
  • Competitive compensation, career growth opportunities, and access to world-class learning resources.

At Microsoft, we believe in diversity and inclusion. We encourage applicants from all backgrounds to apply and ensure that every candidate is evaluated based on their skills and potential.

Are you ready to take your career to the next level and be a part of one of the most impactful security products in the industry? Apply today and let’s build the future of security together!