Lead Full Stack Engineer (InSights)

The Position

OPSWAT is seeking a Lead Full Stack Engineer who can architect and build cutting-edge software solutions across the stack. You will be responsible for developing robust and efficient systems, including Rust-based data processing, stream processing applications, and NoSQL database integrations, as well as Go-based APIs and Python components. This is a hands-on leadership role, requiring a strong background and fluency in backend and frontend technologies, with a focus on high-performance, scalable solutions. You will also be instrumental in shaping the vision and growth of our engineering team as it scales its front end and backend needs.

What You Will Be Doing

• Design and develop Rust-based data processing systems for high-performance, real-time data ingestion and transformation.
• Implement and manage stream processing solutions in appropriate languages for the use cases, enabling real-time analytics and insights across large datasets.
• Build and maintain Go-based APIs, ensuring they are scalable, secure, and optimized for performance.
• Work with NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB, Druid) to handle complex data structures and ensure efficient data storage and retrieval.
• Develop and enhance Python-based components for automation, orchestration, and data integration tasks.
• Lead the technical strategy for full-stack development, defining best practices, architecture guidelines, and the tech stack for future projects.
• Collaborate with cross-functional teams to deliver comprehensive solutions that align with OPSWAT’s overall product and security goals.
• Mentor and guide junior engineers, fostering a collaborative and high-performance engineering culture.

What We Need from You

• 6+ years of experience in full-stack engineering with expertise in Rust, Go, Python, and NoSQL databases.
• Strong expertise in stream processing frameworks (e.g., Kafka, Pulsar, Flink) for real-time data processing.
• Proven experience building scalable APIs with Go, Rust, and Python integrating them into broader systems.
• Familiarity with modern frontend frameworks (React, Vue.js, etc.) for building user interfaces, though this role will primarily focus on backend and data processing.
• Solid understanding of CI/CD pipelines, containerization (Docker, Kubernetes), and cloud platforms (AWS, GCP, Azure) for deployment and scaling.
• Excellent problem-solving skills and ability to design complex systems that balance performance, security, and maintainability.
• Strong communication skills and experience leading or mentoring software engineers in a collaborative environment.

It Would Be Nice if You Had

• Experience with microservices architecture and event-driven systems.
• Knowledge of distributed systems design, particularly in the context of processing and storage at scale.
• Experience with Parquet and similar file formats for storing and interacting with large datasets.
• Experience with gRPC for building high-performance, scalable APIs.
• Familiarity with frontend technologies like React, Angular, or Vue.js for building admin dashboards or internal tools.
• Passion for exploring new technologies and finding innovative ways to solve complex problems in the cybersecurity domain.