Senior Backend Engineer, Customer Facing

OX Security

Location: United States
Job Type: full-time
Salary: Unknown
Posted: July 27, 2025

Job Description

About The Position

OX Security is seeking a CFG (Customer-Facing) Developer to support and enhance the secure deployment and ongoing operation of our platform. This role is ideal for an experienced engineer who thrives in complex infrastructure scenarios, enjoys working directly with customer environments, and is excited about building scalable, secure, and maintainable solutions.

You'll work closely with backend engineers, DevOps, and customer success teams to deploy, configure, and support the product in customer-owned infrastructure. This position is critical for ensuring the seamless functioning of our product in highly regulated or restricted customer environments.

Responsibilities

What You’ll Be Doing

Collaborate with customer success managers and backend/frontend engineers to define deployment-friendly system architecture and integrations for on-prem customers.
Automate installation and upgrade workflows with minimal external dependencies.
Troubleshoot deployment issues in various customer-controlled environments, often with limited observability, and ensure rapid resolution and minimal downtime.
Participate in customer calls to gather insights and continuously improve the on-prem experience.
Contribute to documentation and tooling for internal teams and end users deploying on-prem.

Requirements

What We’re Looking For

Bachelor’s degree in Computer Science or related field.
Minimum 5 years of experience in backend development.
Proficiency in Node.js and scripting for infrastructure automation (e.g., Bash, Python).
Understanding of Kubernetes, Helm, and container-based deployment workflows.
Excellent troubleshooting and debugging skills, especially in unfamiliar or customer-specific setups.

🎯 Who is this job for?

This role is ideal for a Senior Backend Engineer with 5+ years of experience, strong proficiency in Node.js, infrastructure scripting (Bash/Python), and deploying applications via Kubernetes and Helm. Best for someone who thrives in customer-facing scenarios, excels at troubleshooting complex environments, and enjoys improving on-premise deployment workflows. Ideal for candidates based in the U.S. seeking a remote position with a focus on secure, scalable systems.

💬 Potential Interview Questions

How do you approach deploying a Node.js backend application in a customer-controlled Kubernetes environment?
Use Helm charts for templated configuration, containerize with Docker, validate with kubectl, and offer parameterized values for customer customization.
Describe how you would automate installation and upgrade processes for an on-prem deployment.
Build Helm-based upgrade scripts, version configuration values, use CI pipelines to generate release bundles, and verify post-deployment health via readiness checks.
What strategies do you use to troubleshoot backend issues in limited observability environments?
Implement verbose logging with log rotation, use sidecar containers for monitoring, add diagnostic endpoints, and collect runtime diagnostics via customer-shared logs.
How do you design secure, customer-specific backend integrations in regulated environments?
Minimize external dependencies, offer air-gapped deploy options, enforce role-based access, encrypt all stored/secrets data, and comply with customer-specific audit logging.
What’s your experience working with Kubernetes and Helm in production-grade systems?
[Example] Created custom Helm charts for Node.js microservices, defined RBAC, configured secrets with SealedSecrets or HashiCorp Vault, and monitored with Prometheus/Grafana.
How do you handle upgrade rollbacks for customer-deployed environments?
Use Helm revision history, keep backup of secrets/configs, document manual rollback commands, and automate pre-checks before upgrades are applied.
Describe how you’d gather requirements and feedback from customer success managers.
Join onboarding and support calls, track feedback in shared docs or tickets, convert issues into repeatable solutions, and provide a feedback loop on recurring challenges.
How do you write maintainable infrastructure scripts in Bash or Python?
Use modular functions, environment validation, idempotency, inline comments, exit/error handling, and store config defaults in env files or YAML.
What are the key considerations for backend resiliency in a hybrid cloud/on-prem deployment model?
Support retryable service interactions, decouple services via message queues, allow config-driven URLs or endpoints, and design for partial failure handling.
How do you ensure documentation is effective for both internal teams and external customers?
Write clear step-by-step instructions, provide example configs, maintain troubleshooting sections, use diagrams for architecture, and sync updates with code changes.

📋 Job Summary

OX Security is hiring a Senior Backend Engineer (remote, USA) to support secure, scalable deployment of its platform in customer-owned environments. You’ll work with Node.js, Kubernetes, Helm, and scripting tools to automate installations, troubleshoot issues, and improve on-prem experiences. Ideal for engineers with 5+ years’ experience who enjoy hands-on infrastructure work, cross-team collaboration, and direct customer impact. Join a fast-paced security company and help shape the reliability and success of critical deployments.