DevOps Engineer

Role Summary

We are looking for a DevOps engineer to build and operate cloud-native foundations and to partner closely with AI and application engineers. This is a hands-on role spanning DevOps fundamentals — Kubernetes, CI/CD, GitOps, and infrastructure-as-code — and AI/ML infrastructure such as GPU-backed model serving and the data services that AI applications depend on.

You will help stand up pragmatic, right-sized platform foundations and act as the infrastructure partner to application engineers — deploying and scaling their services reliably, keeping the developer loop fast, and building security and observability in from the start. We are looking for a candidate with a strong academic record and solid computer-science fundamentals (data structures, algorithms, and problem-solving) alongside hands-on platform experience.

Key Responsibilities

DevOps Foundations

Bootstrap and operate Kubernetes (AKS) plus the surrounding cloud-native foundations: container registry, secrets management, identity, and monitoring.
Own the build-and-deploy path end to end — containerisation (Docker/BuildKit), image registry, CI/CD (GitHub Actions or Azure Pipelines), and GitOps (Argo CD or Flux).
Codify infrastructure with Terraform and/or Bicep and Helm so environments are reproducible and reviewable.

AI Infrastructure & Data Plane

Package and deploy application and AI/agent services, including the runtime, secrets, and configuration they require.
Provision and operate the data plane: managed PostgreSQL, Redis, a vector store, a graph store, object storage, and a queue / event bus.
Stand up self-hosted inference — e.g. vLLM on a GPU node pool — alongside hosted-model connectors; use KEDA/HPA to scale stateless pods (down to zero) and bin-pack GPU efficiently.

Isolation, Security & Reliability

Implement tenant/workload isolation: namespaces, deny-by-default NetworkPolicy, ResourceQuota/LimitRange, and scoped secrets.
Manage secrets and identity with a secrets manager / KMS and an identity provider; keep credentials out of code.
Establish observability and basic SRE practice: OpenTelemetry, Prometheus + Grafana (or cloud-native monitoring), tracing, alerting, and runbooks.

Collaboration & Cost

Pair with application engineers on inference, persistence, and durable-execution concerns.
Keep the platform cost-aware — right-size nodes, scale to zero, and surface spend.
Contribute to engineering standards and a fast, low-friction developer loop.

Required Technical Skills

Domain Skills & Technologies Must / Preferred CS Fundamentals & DSA Data structures, algorithms, complexity analysis, strong problem-solving Must Kubernetes AKS — deployments, services, autoscaling, ingress, namespace isolation Must DevOps Fundamentals Docker, CI/CD (GitHub Actions or Azure Pipelines), Git workflows Must Infrastructure as Code Terraform (and/or Bicep), Helm Must Cloud Azure (AKS, ACR, Key Vault, Entra ID, Monitor); managed PostgreSQL/Redis/Blob/Service Bus Must GitOps Argo CD or Flux Must Observability OpenTelemetry, Prometheus, Grafana (or cloud-native monitoring) Must Scripting Python and/or Bash for glue, automation, and debugging app services Must GPU / ML Infra GPU scheduling, serving LLMs with vLLM, GPU bin-packing & cost optimisation Preferred Autoscaling KEDA event-driven autoscaling, scale-to-zero Preferred App Runtimes Deploying Python application / AI services (e.g. FastAPI, LangGraph), Temporal Preferred Mesh / Gateway / Secrets Istio, Kong / API gateways, HashiCorp Vault Preferred Sandboxing & Supply Chain gVisor / Kata Containers; Sigstore/cosign, SBOM (Syft), SLSA Preferred

Qualifications & Certifications

Strong academic record — B.Tech / B.E. / M.Tech / MCA in Computer Science or a related field from a reputable institution (or equivalent).
2–3 years of hands-on experience in DevOps / platform / infrastructure engineering, with practical Kubernetes exposure.
Strong data structures, algorithms, and problem-solving skills.
Experience supporting application engineers (deploying services, debugging runtime issues) and working with cloud infrastructure; exposure to production clusters is a plus.

Preferred Certifications

Certified Kubernetes Administrator (CKA) / CKAD
Microsoft Certified: Azure Administrator / Azure Solutions Architect
HashiCorp Terraform Associate

Soft Skills & Cultural Fit

Pragmatic and outcome-driven — builds the minimum viable platform first, avoids premature complexity.
Collaborative; genuinely enjoys pairing with application engineers and unblocking their deployment/runtime problems.
Strong ownership and on-call maturity; calm, methodical incident response.
Clear communicator across technical and non-technical stakeholders.

What We Offer

Hands-on work across modern cloud-native and AI infrastructure — Kubernetes, GPU inference, GitOps, and durable workflows.
High ownership of the platform and infrastructure from an early stage.
Competitive compensation with a structured performance review process.
Professional development support — certifications (CKA, Azure), conferences, and emerging tooling.
Collaborative, transparent culture with clear growth pathways toward Staff / Principal platform engineering.

About Softobiz Technologies

Softobiz Technologies is a technology and product services company headquartered in India, operating Global Capability Centers (GCCs) for leading international clients across healthcare, fintech, and enterprise software. Our GCC model enables world-class talent in India to work directly within the product and engineering teams of our global partners, contributing meaningfully to product strategy, growth, and operations

Innovation begins with like-minded people aiming to transform the world together. At Softobiz, we invite you to become a part of an organization that has been helping clients transform their business by fusing insights, creativity, and technology. With a team of 400+ technology enthusiasts, we have been trusted by leading enterprises around the globe for over 18+ years.

At Softobiz, we foster a culture of equality, learning, collaboration, and creative freedom, empowering our employees to grow and excel in their careers. Our technical craftsmen are pioneers in the latest technologies like AI, machine learning, and product development.

Why Should You Join Softobiz?

Work with technical craftsmen who are pioneers in the latest technologies.
Access training sessions and skill-enhancement courses for personal and professional growth.
Be rewarded for exceptional performance and celebrate success through engaging parties.
Experience a culture that embraces diversity and creates an inclusive environment for all employees.

Softobiz is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will be afforded equal employment opportunities without discrimination based on race, creed, color, national origin, sex, age, disability, or marital status.

Softobiz

New Jobs

SB-1445-DevOps Engineer