Developer Experience (DX)
Search documents
Leadership in AI Assisted Engineering – Justin Reock, DX (acq. Atlassian)
AI Engineer· 2025-12-19 18:14
Impact of Generative AI - Industry averages show modest positive indicators with a 75% increase in documentation quality and a 34% increase in code quality [6] - Some companies experience up to 20% increases in change confidence, while others see 20% decreases, highlighting extreme volatility [8] - An increase of 2% in change failure rate, against an industry benchmark of 4%, could mean shipping up to 50% more defects [9] Strategies for Successful AI Adoption - Top-down mandates for AI adoption are ineffective; lack of education and enablement negatively impacts adoption [9][10][11] - Clear AI policies and dedicated time for learning and experimentation are crucial for moving the needle [12][13] - Integrating AI across the Software Development Life Cycle (SDLC) and addressing bottlenecks beyond just code completion is essential [13][14] - Open discussions about metrics and evangelizing wins are necessary to reduce the fear of AI and ensure employee success [15][16] Metrics and Measurement - Focus on speed and quality metrics, including PR throughput, change failure rate, change confidence, and maintainability [21][22] - Utilize telemetry metrics, experience sampling, and effective surveys to gather comprehensive data [22][23][24][25] - Implement a DXAI measurement framework, considering utilization, impact, and cost to assess AI maturity [28][29] Compliance and Trust - Establish feedback loops for system prompts to ensure the output is trustworthy and aligned with organizational standards [33][34][35] - Understand and control the temperature setting to manage the determinism and non-determinism of AI models [35][36][37] Employee Success - Provide education and adequate time for developers to learn and experiment with AI, focusing on valuable use cases like stack trace analysis [40][41][42][43] - Leverage self-hosted and private models, partner with compliance from the start, and think creatively to unblock AI usage [44] Optimizing the SDLC - Identify and fix bottlenecks in the SDLC, as time saved on non-bottleneck areas is worthless [45][46] - Learn from examples like Morgan Stanley, which saves 300,000 hours annually by using AI to modernize legacy code [47][48] - Emulate Zapier's approach by using AI to enhance onboarding and increase the effectiveness of new engineers [49][50]
AX is the only Experience that Matters - Ivan Burazin, Daytona
AI Engineer· 2025-07-24 14:15
Agent Experience Definition and Importance - Agent experience is defined as how easily agents can access, understand, and operate within digital environments to achieve user-defined goals [5] - The industry believes agent experience is the only experience that matters because agents will be the largest user base [33] - The industry suggests that if a tool requires human intervention, it hasn't fully addressed agent needs [33] The Shift in Development Tools - 37% of the latest YC batch are building agents as their products, indicating a shift from co-pilots and legacy SAS companies [1] - The industry argues that tools built for humans are for the past, and the focus should be on building tools for agents [3] - The industry emphasizes the need to build tools that enable agents to operate autonomously [12][13] Key Components of Agent Experience - Seamless authentication is crucial; agents should be able to authenticate without exposing passwords [6][7] - Agent-readable documentation is essential, with standards like appending ".md" to URLs and using llm's.txt [8][9] - API-first design is critical, providing agents with machine-native interfaces to access functionality efficiently [10] Daytona's Approach to Agent Native Runtime - Daytona aims to provide agents with a computing environment similar to a laptop for humans [19] - Daytona's initial focus was on speed, achieving a spin-up time of 27 milliseconds for agent tools [21] - Daytona preloads environments with headless tools like file explorers, Git clients, and LSP to help agents do things faster [22] Daytona's Features for Autonomous Agents - Daytona offers a declarative image builder, allowing agents to create and launch new sandboxes with custom dependencies [27] - Daytona provides Daytona volumes, enabling agents to efficiently share large datasets across multiple machines [29] - Daytona supports parallel execution, allowing agents to fork machines and explore multiple options simultaneously [31]