The Tech-job Interview: Secrets of Making It Fair and Effective

BY Emily McCrary-Ruiz-Esparza | November 12, 2021

Everyone has had the experience of interviewing for a job and being turned down. The answer you got was likely something like this one I received once: “While we were very impressed with your qualifications, we were faced with a difficult decision; we finally selected another candidate who we believe more closely fits the position’s requirements at this time.”

What if, instead of giving interviewees a yes or no answer about the job, companies were more candid about missing skills that might have changed the outcome? What if promising candidates were given the opportunity to try the interview again? And what if employers focused on building relationships with talented candidates before they’re ready to hire?

“It was crazy to us at Karat that candidates just get rejected for jobs and companies never track their aptitude or how they’re progressing,” said Mohit Bhende, cofounder and CEO of Karat, a company that is pioneering the Interviewing Cloud to conduct technical interviews for enterprise-scale hiring of software engineers. “I would say that forward-looking clients, they've stopped rejecting candidates. Instead, they say, ‘Hey, you're not ready.’ They use the term ‘not ready,’ rather than a binary yes or no. And when you lead with that, it changes the equation.”

This simple change has led Karat’s client companies to form relationships with job candidates, grooming larger, more diverse and richer talent pools. It has helped them improve their reputation as an employer and create networks of potential future hires. “That is a total mindset shift on what the interview can be, to not think about the interview as a one-stop shop or one point in time, but to think about it as a way to build a relationship with a candidate,” said Bhende, who I interviewed in a recent From Day One webinar titled “The Inclusive Job Interview: How It's Making Tech Recruiting Effective, Efficient, and Equitable.” We discussed how employers can reimagine the interview process to increase efficiency, improve employee retention, and support goals toward diversity, equity, and inclusion (DEI).

What Happens When You Rethink the Interview Process

Karat has seen first-hand what happens when the interview process is thoughtfully planned, carefully executed, studiously measured, and constantly improved. “The most immediate benefit,” Bhende said, “will be maximizing your current workforce so that you just get more throughput, happiness, morale, and retention.”

The very idea for Karat was born out of this need. Bhende needed to hire hundreds of engineers for his team at Xbox, where Bhende led global product strategy in 2010-13. “I started one day just counting the sheer number of hours that my engineers were spending interviewing, versus coding. None of our engineers were formally trained in how to be good interviewers, and so the net result was countless hours going into a process that was oftentimes inconsistent.”

In creating Karat, Bhende and his cofounder Jeffrey Spector took it upon themselves to solve the efficiency problem, building a network of engineers, working outside of a given organization, who are trained to interview for consistent and equitable results.

Beyond creating immediate efficiency, the effects of a well-conceived interview structure are long-lasting. It brings in talented people who add value to an organization–Bhende favors the notion of “cultural add” over “cultural fit”–and it helps companies prepare for the future in a consistent manner.

A conversation on job interviews: Mo Bhende, CEO of Karat, and journalist Emily McCrary-Ruiz-Esparza (Image by From Day One)

Hiring practices that invest in candidates beyond a single interview address the growing skill gap. Forty-three percent of executives and managers say their organizations currently have a skill gap, according to a survey by McKinsey & Company, and an additional 44% say that a gap will open in the next five years. The same survey indicated that executives and managers who prioritize skill-building among current employees are more likely to consider themselves prepared to address role disruptions caused by the skill gap than are those preparing for the skill gap through other methods, like hiring contract workers.

Interviews in which the evaluator interacts closely with the person being evaluated are better at testing for aptitude and potential than traditional interviews, Bhende said. “Most interviews today are really focused on ‘Can you do the job today?’ But what you should really be thinking about is, ‘If I give you learning and kind of guidance in the interview, can you learn and demonstrate the ability to learn the job I want you to do?’”

How Interviewing Practices Affect Black Engineers’ Access to Tech Jobs

The role of well-designed interview programs in furthering DEI in the workplace, especially in tech environments like the ones Karat supports, shouldn’t be underestimated. “There is a sheer processing and expansion of opportunity that a well-run tech program will do to drive better and more equitable outcomes,” Bhende said.

Karat has studied this effect. In September, the company released “The Interview Access Gap for Black Engineers,” a report created in partnership with Howard University, which examines how exposure to computer science education, tech industry networks, and interview practice opportunities–or lack thereof–affect the ability of Black engineers to land tech jobs. The survey found that access to these three factors significantly increases candidate confidence, reduces feelings of imposter syndrome, and ultimately influences career trajectory.

Bhende said the companies that achieve and maintain diversity goals will do so because they prioritize candidate-centric interviews. “What do all of the diverse candidates that we brought into the company seek and want? They want learning, they want growth, they want fulfillment, they want compensation. It's such a simple metric flip. If you start with the customer and work back, it'll yield a better outcome than starting with the business objective.”

How to Design an Effective and Equitable Interview Program

Though Karat specializes in conducting technical interviews for companies hiring software engineers, the principles can apply to interviews more broadly. Bhende encouraged employers to think of it as skills-based interviewing. “What Karat is really focused on is demonstration of craft, demonstration of skills, demonstration of expertise. And so the nature of the interviews are inherently technical in that they are evaluating your ability to learn the job or do the job.”

        1.) Name the Who and How: The first step is considering who will conduct the interviews, and how. Bhende was clear that it shouldn’t necessarily be the first person to volunteer. “Just because you raise your hand or you’re a good engineer doesn't necessarily make you a good interviewing engineer,” he said. “I think our data has been very clear that those are actually fundamentally different skills.”

All Karat interview engineers go through training that includes how to use technology to mitigate bias. Bhende said that in their process, the interviewer “never scores the candidate, all the interviewer does is say, ‘Here's what happened in the interview.’ Our tech scores the candidate.” Karat interviewers are also equipped with “battle-tested” questions–the company tests their questions across broad cohorts for bias–and the methodology for asking them. The Karat program even cues the interviewer about the appropriate times to give hints, in order to reduce the effect of subjectivity on the part of the interviewer.

     2.) Align It With Your Identity as an Employer: Identify the goals of the interview and the impression it will leave on the prospective employee. “How is that interview program going to reflect the brand experience and the employee experience that comes downstream? The employee experience starts at the point of hire.” For example, many professionals now work from anywhere, anytime–and yet the interview process to get one of those jobs often follows the old 9-to-5 model. Bhende believes the two should be more closely aligned. “How you get hired and how you work, ideally, are reflective of each other. And so the hiring process itself should be inclusive, it should be flexible, it should be candidate-responsive.”

That means offering interviews at times convenient to candidates–when they perform at their best, on days that work best for them. “I think the future of work is quickly evolving and interviewing is evolving from candidates fitting into a company model to one that is much more flexible and ultimately accommodating.”

Flexibility also includes rethinking how companies relate to candidates. Don’t underestimate the power of a do-over, Bhende said. “It’s ridiculous that people are coming to interviews, not doing well, and they will forever never get the job,” he said. Candidates often perform better on their second tries, he said, with “convincingly high” improvement ratios. “I would just encourage the industry as a whole to adopt [this], because I think it's just a higher-empathy way to lead.”

      3.) Plan for Internal Communications: The program should clearly identify how communication between the interviewer and hiring team will work. “How are the handoffs going to work between the recruiter to the engineer, back to the recruiter? Having a guideline of what that's going to look like is really critical,” Bhende said.

      4.) Keep Improving the Process: “I would encourage any company that is thinking about designing a program to really think hard about where you are going to get signals to improve that interview over time. It's really critical,” he said. “Even our own interviews, they’re constantly adapting and constantly changing for companies as we get more data on what's predictive, what really matters. The interview can evolve and change.”

Bhende said Karat asks interviewees to score as much of the interview process as possible. “They score the company, they score the question, they score everything.” All of this is in the service of treating the candidate like a customer, a practice Bhende repeatedly recommended during our conversation. As corporate America moves toward providing a consumer-grade employee experience, feedback is indispensable.

Editor's note: From Day One thanks our partner who sponsored this webinar, Karat.

Emily McCrary-Ruiz-Esparza is a writer, editor, and content strategist based in Richmond, Va.


RELATED STORIES

HR Planning & Budgeting 2025: How To Maximize Your Employee Experience Investment

The end of the year approaches fast, and for businesses and organizations, this indicates the time to complete annual budget plans for the coming year. Decisive strategies delivering the highest ROI are driving an industry shift, placing employee experience (EX) at the forefront of organizational priorities.“We are in a new wave of focusing on our employees, which is different from the way organizations used to operate,” said Rob Catalano, chief marketing and strategy officer for WorkTango. “We need to be intentional that employee experience is important. When we create our plans and strategies we are thinking about them as well.”Emily McCrary-Ruiz Esparza, journalist and contributing editor at From Day One spoke about the importance of employee experience when approaching the budget planning with Catalano during a From Day One webinar titled, HR Planning & Budgeting 2025: How To Maximize  Your Employee Experience InvestmentBoosting employee relationship management yields the benefits of higher morale, and in turn  increases retention and employee engagement. A Gartner survey supports this, with these five priorities for HR leaders in 2024:  Leader and Manager Development Organizational Culture HR Technology Change Management Career Management and Internal MobilityThe survey's top three priorities highlight how HR leaders are embracing change and the need for strategic agility. Happy employees drive stronger company profits. According to Harvard Business Review's study, How Employee Experience Impacts Your Bottom Line, organizations that prioritize employee experience in their budgets see revenue and profits rise by at least 50%.Organizations that fail to integrate employee experience into their current and future strategies risk falling behind, says Catalano. HR leaders must leverage technology, AI, and other digital tools to achieve the same success through robust employee experience initiatives.Rob Catalano of WorkTango led the webinar (company photo)“Technology needs to be that critical part of your strategic planning and your budget carved  out for these types of things if you want to impact that employee experience,” said Catalano.Annual employee surveys don’t yield the fastest employee experience results anymore. Many employee issues aren’t identified and resolved until several months later.  “No one’s going to act or do something different if you’re only getting your engagement index of how people feel once a year,” Catalano said.How To Approach Budgeting and ROIInvesting in employee experience doesn’t require a large portion of a company budget. Two thirds of companies that invested less than $10,000 saw a ROI up to 5 times. What is more important is identifying and measuring what Catalano calls the three pillars, People ROI, HR  ROI, and Company ROI.Every company will determine these metrics differently as they should–ROI is not one size fits  all. One company can receive a high ROI with the same plan another company used, who only saw a minimal ROI.“If we think about employee experience and all those pillars, there isn’t a silver bullet when  companies are thinking of a multi threaded experience strategy. You can’t do it all, but be  thoughtful. What are the right things that are employee focused versus company focused?”Editor’s note: From Day One thanks our partner, WorkTango, for sponsoring this webinar. Mary Jones is a freelance writer out of Ohio. Her work is featured in several publications including The Dallas Express, NDash, and The Daily Advocate.

Mary Jones | November 20, 2024

Want to Retain Your Workers? Show You Genuinely Care About Their Mental Health

When employers make a sincere effort to support the well-being of their workers, does that investment have a positive return for the company? Does it go beyond goodwill to improved corporate performance? Nivati, an employee mental-health platform, decided to find out.In a study of 25,741 workers at 56 companies that used the Nivati platform during 2023-24, the company found a dramatic impact among employees who were fully engaged with the platform: a high level of employee retention. The overall turnover rate within this group of employees was only 1.7%, meaning they were eight times more likely to stay in their jobs than co-workers who were only casually engaged with the program.Retention is a key number for employers because unwanted turnover can be so expensive. According to Gallup research, “replacing leaders and managers costs around 200% of their salary, replacing employees in technical roles costs 80% of their salary, and replacing frontline workers costs 40% of their salary, excluding unmeasured losses in morale and knowledge.”Yet reducing employee turnover is not merely about cutting costs; it’s strategic investment in an organization’s future. By embracing programs that enhance engagement, satisfaction, and overall workplace culture, employers can cultivate a loyal and motivated workforce. The benefits—ranging from improved productivity to enhanced customer satisfaction—far outweigh the costs.The American workforce’s state of mental health is often described as a crisis. How does that present itself on the job? “Employees often approach Nivati struggling with mental health challenges like stress, burnout, anxiety, relationship challenges, and work-life balance issues, which are major contributors to workplace dissatisfaction,” said Nivati CEO Amelia Wilcox, who founded the company in 2020. “When companies don’t provide mental health support, employees are more likely to leave due to feeling unsupported or unable to cope with their work environment.”In the nearly five years since the start of the pandemic, many factors inside and outside the workplace have aggravated employee stress. “The shift to remote and hybrid work, combined with economic uncertainty and social isolation, has significantly affected employee wellness,” said Wilcox.Amelia Wilcox, CEO and founder of Nivati (Company photo)While many companies have stepped up their support for good mental health, there’s still a significant gap. “Many employees are still unaware of these benefits and underutilize them. This commonly stems from lack of communication and engagement strategies that remind employees and make employees feel like the resource is readily accessible and OK for them to use,” Wilcox said.Cultural challenges are a factor too, especially when a company talks a good game about mental health but fails to make it a core value. “For instance, if a company is saying they value mental health and then covertly sends the message that taking time off is not OK, the employees internalize those covert messages over the overt messaging the employer is trying to send,” said Wilcox. “Effective onboarding, consistent conversations on mental health, periodic reminders, and visible support from leadership increase utilization, making employees more aware that their employer genuinely cares about their well-being.”Karen Fikse, senior director of HR at Cummins, the engine manufacturer, said in a From Day One panel discussion that the idea of leaders practicing what they preach formed the basis of her company's “It’s Okay” campaign, which provides managers with resources to process whatever they’re going through–be it anxiety, stress, pressure or hardship.In the five years since its Nivati’s inception, said Wilcox, “we’ve learned that the key to impactful mental health support is a holistic approach, including therapy, fitness, finance, and self-care tools, all made accessible within a flexible platform that meets employees where they are. We’ve also learned that some people aren’t comfortable with jumping right into therapy. So our platform was designed to allow people to start in an area that’s less ‘scary’ for them and build trust with the platform and team. They can take baby steps to grow into therapy.”Before any therapy or other steps happen, the pathway needs to be a welcoming one. Nivati’s platform “provides an intuitive experience for employees to seek help: from signing in and selecting self-guided resources around mental health, nutrition, or finance—to scheduling and engaging with qualified professionals in each of those areas of well-being. The entire process is designed to be simple and confidential,” Wilcox said.Nivati partners with a network of hundreds of licensed therapists, registered dietitians, life coaches, financial advisors, meditation practitioners, yoga instructors, personal trainers, and more. These providers work 1:1 with employees, they facilitate group training and education for Nivati’s customers, and they create the content for the self-guided resources on the company’s platform.Even for workers who aren’t at risk of quitting their jobs, in many cases because they need the financial security, paying attention to their mental health can lead to thriving on the job rather than every day being a struggle. They can reframe their work experience and boost their resiliency. Nivati’s platform has a career development and coaching category to help workers grow in their roles as well. “Even if these employees aren’t leaving,” Wilcox said, “providing them with support can increase their satisfaction and productivity, ultimately benefiting both them and their employer.”Editor’s note: From Day One thanks our partner Nivati, who sponsored this spotlight.(Featured photo by SDI Productions/iStock by Getty Images)

the Editors | November 20, 2024

How to Provide Best-in-Class Menopause Support in the Workplace

Despite it impacting half the population, menopause is rarely discussed. For many women, life-altering symptoms strike just as they’re reaching the peak of their careers, disrupting them at a time when peak performance is critical. Companies must step up and provide support, or they could potentially lose 20% of these women who move to less demanding jobs.MaryAnne Hraba, RVP of employer growth at the Maven Clinic and Dr. Toni Morrissey, OB-GYN at the Maven Clinic spoke about providing best-in-class menopause support during From Day One’s October virtual conference. Jenny Sucov, health and well-being journalist moderated the thought leadership spotlight. Maven is a team of health care advocates across the world who offer personalized care via telehealth. They partner with over 2,000 employers and health plans to bridge the gaps between limited access to care for everything from fertility treatment to pediatric care, including filling the gap in traditional menopause care.Opening the DialogueSeveral years ago, Hraba started experiencing what she now knows is symptoms of perimenopause, including worsening depression and anxiety, low libido, and it became increasingly difficult to sleep. The most cumbersome symptom, especially with regards to showing up for work every day, was brain fog.“I seriously thought that I had something wrong with my brain,” she said. “It just wasn't working anymore, like having a hard time even reacting in conversations.” She had no idea what was going on with her body. “It was just so hard to get through every single day.”She went to see her OB-GYN and explained what was happening, but during the short visit was simply told that is what happens when you get older. No help or relief. Later, Hraba went down a Google rabbit hole, which made things worse. Unfortunately, only about 20% of OBs receive any sort of formal training on menopause, says Sucov.Hraba then turned to Maven for care. She scheduled a virtual appointment with one of their OB-GYNs who was trained in menopause. “I got more out of that 15-minute appointment than anything prior,” Hraba said.Dr. Toni Morrissey and MaryAnne Hraba of Maven Clinic spoke on "How to Provide Best-in-Class Menopause Support in the Workplace" (photo by From Day One)Questions about hormone replacement therapy, supplements, and a clear direction of where to go next were answered. “Finally, I was being seen and being heard, which was the first step.” She also got access to clinically vetted content she could trust, as well as community forums of other women experiencing similar issues. Additionally, she asked Maven for a local doctor who was trained to better help her and was connected with one covered by her insurance.“Fast forward. Now I’m talking to this provider in person. I’m a lot more empowered, a lot more educated, and I’m able to have that two-way conversation,” Hraba said.She still uses the Maven app for resources she doesn’t have access to locally, but when it comes to women’s health, it is going to take more than just one provider to fulfill her needs. “It's still a process. There’s no single magic bullet.” But thankfully, now that she feels better, her life—including her work life—have improved exponentially, she says.  Workforce ImpactThe implications of menopause in the workplace are more far-reaching than employers may realize. “Menopause isn't just a personal health journey,” Dr. Morrissey said. “It impacts everybody around them in the workforce.”Untreated symptoms can render even the most resilient individuals less able to manage stress, leading to higher absenteeism and decreased productivity, says Dr. Morrissey. Moreover, menopause often coincides with a pivotal career phase when many women are in or approaching leadership roles. Without adequate support, companies risk losing experienced professionals and stalling diversity progress in senior positions.“Employers who invest in comprehensive menopause support aren’t just doing the right thing for their people, but they're making a smart business decision, and they’re creating a culture that normalizes conversations about menopause and provides meaningful, holistic care,” said Dr. Morrissey. How do women who go through this type of care feel? “They typically will say, now I feel back to myself.”Effective Menopause BenefitsProviding tailored menopause benefits, such as telehealth consultations and educational resources, empowers employees and cultivates a culture that normalizes and supports women's health at all stages. By integrating menopause care into their wellness programs, employers can demonstrate a commitment to their workforce’s well-being, fostering loyalty and positioning themselves as leaders in employee care.Here’s what Dr. Morrissey recommends for employers to make sure is included in menopause coverage:Access to Specialty Care: Employers should provide on-demand, virtual access to a variety of specialists (e.g., GYNs, mental health providers, sex coaches, nutritionists, career and physical support coaches) to address the wide range of menopause symptoms. Global and same-day support empowers employees to manage their health comprehensively.Education and Community Resources: Expert-reviewed resources such as articles, webinars, and community support should be available to educate employees and help them understand and manage symptoms.Personalized Care Plans: Employees need individualized care plans that consider their medical history, lifestyle, and personal circumstances. Concierge support should help them navigate care and connect to specialists and local providers as needed.Addressing menopause in the workplace is no longer optional—it’s a vital aspect of supporting employees’ well-being and fostering an inclusive work environment. As more women reach pivotal stages in their careers while navigating the challenges of menopause, companies that proactively offer comprehensive support can stand out as leaders in employee care. Editor’s note: From Day One thanks our partner, Maven Clinic, for sponsoring this thought leadership spotlight.Carrie Snider is a Phoenix-based journalist and marketing copywriter.

Carrie Snider | November 18, 2024