This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers.
She will pick the best candidates from Jack's network.
The next step is to speak to Jack.
Job Title
Member of Technical Staff, Infrastructure
Salary
$120K – $250K + Equity
Company Description
The Token Company is a $12M seed-stage startup backed by First Round Capital, NEA, and YC, building specialized machine learning models to compress LLM inputs. By identifying and removing unimportant data before it hits expensive models, they drastically reduce inference costs for high-scale enterprises and tech companies integrating LLMs into their production workflows.
Job Description
You will own the end-to-end cloud infrastructure for a high-performance compression API. This role involves building global, low-latency GPU ML inference systems that sit directly in the critical path of customer traffic. As a core member of a 5-person team, you will drive reliability, scalability, and cost-efficiency for a revolutionary AI product.
Location
San Francisco, USA
Why this role is remarkable
- Join an elite 5-person team backed by $12M from top-tier investors like First Round Capital and founders of Dropbox, Slack, and Supercell.
- Solve critical infrastructure challenges for LLM efficiency, building the low-latency systems that enable enterprises to scale AI cost-effectively.
- Benefit from an unparalleled San Francisco living experience with provided housing, food, laundry, and cleaning services, plus full visa sponsorship.
What You Will Do
- Architect and manage global, high-throughput GPU inference infrastructure using AWS, Terraform, and Docker to ensure maximum performance and uptime.
- Own the entire infrastructure stack from initial deployment and CI/CD pipelines to long-term reliability and cost-efficiency research.
- Collaborate closely with research and product teams to integrate and scale compression models into a high-traffic production API.
The ideal candidate
- Demonstrated experience building and operating production-grade cloud infrastructure at scale using tools like AWS and Terraform.
- Strong background in managing containerized environments with Docker and establishing robust CI/CD pipelines for high-reliability systems.
- Proven ability to take end-to-end ownership of an infrastructure stack, ideally within a fast-paced startup or high-growth engineering environment.
Who are Jack & Jill?
Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
How does this work?
- Jack's an AI agent for job searching and career coaching. He works for you.
- Jill is the AI recruiter working for the company. She recruits from Jack's network.
- If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives.
We never post fake jobs
This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network.
Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description.
We appreciate this can make them look a bit suspect, but there isn't much we can do about it.
Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.
