The emergence of voice-controlled devices like Siri, Amazon Echo, and Google Home have simplified tasks that previously required a keyboard. But we've only just begun to inhabit a world filled with devices that we control in different ways, one where we can accomplish more by what we say than what we can do. aims to tackle an interesting problem: writing code through speech. Serenade Serenade is a voice-to-code software that's available to plug into several popular IDEs, like VS Code and IntelliJ. Their claim is to allow you to code "using natural speech," and with support for nearly a dozen languages, it's an intriguing proposition. The ability to code through voice commands is more than just a Sci-Fi fantasy. For programmers with carpal tunnel, or other more severe physical ailments, coding can continue to provide them access to the creative endeavor they enjoy—and a living. Is Serenade actually viable? In this post, we'll put the program to the test. My colleague Garen and I will attempt to build a Node.js site, with a simple HTML and CSS frontend, using only our voice. Our site will be nothing more than a button that, when clicked, will display a random emoji. To truly immerse ourselves in the hands-free experience, we'll also attempt to deploy the app to using their . Let's get started! Heroku CLI Set up the server As with most new projects, we'd like to create a new directory, change into it, and install my package dependencies. Since we can only use Serenade within the IDEs they support, we must resort to , which is  lacking and unable to comprehend programmer speak. We must explicitly spell out Unix commands, or the program won't understand them. Furthermore, there doesn't seem to be any way to enforce lowercase, which really irks the directory aesthetic. Perhaps most frustrating of all is the inability to speak filename conventions. macOS' Dictation feature In order to move this along, we just typed on the command line, created a new file called server.js, and opened up Visual Studio Code. Hands 1, Voice 0. npm i express --save-dev Serenade runs on your computer and detects your IDE, in order to integrate with its functionality. After installing and activating the app, you can pretty much get started by issuing explicit directives. In the event that Serenade didn't understand, you can choose a visual option to resolve the ambiguity. There are to help you begin learning the directives. Here's our first try: several tutorials available First attempt at using Serenade There's a lot to like about how Serenade works: it knows common IDE commands like "delete word". Additionally, in general, if you speak out a sentence, it'll know when to add spaces and semicolons. However, one issue to keep in mind is the fact that Serenade has three different ways to add text: , which is a general way to describe a line insert , which specifically recognizes language features like classes and functions add , which enters raw, plain text type Knowing which one to use can be a bit confusing, but after spending some time with the program (and thoroughly reading the documentation), it is possible to move at a somewhat faster clip. However, phrases are still misunderstood from time to time: Moving a little faster as I learn the syntax There seems to be some confusion about where to place parentheses and arguments. On occasion, it can feel like we're fighting against the app's syntax, rather than it understanding me. Hands 2, Voice 0. Write the HTML and CSS Let's assume we did manage to get a basic server going: express = ( ); app = express(); path = ( );

app.get( , {
   res.sendFile( );
});

app.listen( ); const require 'express' const const require 'path' '/' ( ) function req, res '/index.html' 8080 We'll now write a file called index.html to represent the entirety of our design. HTML is meant to be a structured language; how does it fare? HTML for the win Success! Writing HTML is a breeze. We were worried there would be some mistakes with tag placement, especially after adding the attributes, but the alignment and nesting are well understood. Hands 2, Voice 1. Let's move on to the CSS: CSS also works well This is an example of when a really close understanding of the underlying language's grammar is really important; I never knew the bracketed CSS definitions were specifically called "rulesets."  Still, at this point, we've started to understand how Serenade works, including its nifty capability to move directly to a line. Hands 2, Voice 2. Write the client-side JavaScript Our final HTML and CSS will end up looking like this: <!DOCTYPE html> <head>
    <link rel=stylesheet type=text/css href=/main.css></link>
    <script src="main.js"></script>
    </head> <body>
    <h1>hello!</h1>
    <p id="container"></p>
    <button id="emoji">Emoji!</button>
    </body> < > html </ > html h1 { : blue;
  margin-top: em;
}
#container {
  text-align: center;
} color 1 To avoid executing our JavaScript immediately, we need to wait for to fire before setting up any event listeners. Capitalization matters here, and we couldn't get Serenade to recognize the right spelling: the event DOMContentLoaded Capitalizations are a challenge Still, either through our increased proficiency with Serenade, or the relatively straightforward nature of what to add, it was easy to add the event handling code. As programmers are not infallible, we intentionally tried to make mistakes to see if Serenade could recover. For example, we missed some indentation: We'll call this one a draw. Deploy to Heroku For the final piece of our test, we need to deploy to Heroku. Heroku requires a Procfile, which is rather short for this project. web: node index.js Unfortunately, once again, the obstacle here is switching to the Dictation app, which simply cannot understand the commands required to push this application up to Heroku: With a final clinch at the end: Hands 3, Voice 2. Conclusion Serenade is pretty fun to use. Navigating the IDE is solid, and explicitly speaking out the proper names for programming concepts makes one feel like a wise sage. However, it requires a specific understanding of the various commands, which doesn't feel like speaking English; it feels like I'm speaking specific instructions to a computer, rather than a person I'm pair programming with. Still, I'd recommend it as a system to augment your current two-handed coding style, rather than a full-on replacement. With practice and patience, it could be a useful tool for developers who otherwise can't code. And as a nice touch, the company provides to anyone who wants to get started quickly. free one-on-one training Another issue that I did not note here is that, like any good programmer, I frequently relied on the internet to look up specific APIs. This means that I spent the majority of my time navigating away from the IDE (and Serenade), which tested Dictation's coping capabilities. We're not quite at the point of fully composing applications with voice (and there's a long way to go before we can deploy them), but we're getting closer. Also published behind a paywall on: https://medium.com/better-programming/code-by-voice-using-serenade-5f51f4153854

Amazon

Google

Heroku

I write about technology michael.bogan@gmail.com

2022 - HackerNoon Contributor of the Year - Api

2022 - HackerNoon Contributor of the Year - Devops

2022 - HackerNoon Contributor of the Year - Microservices

2022 - HackerNoon Contributor of the Year - Software

2022 - HackerNoon Contributor of the Year - Software Architecture

2022 - Software Developer of the Year

Nominated for 2022 - HackerNoon Contributor of the Year - Software Architecture

Nominated for 2022 - HackerNoon Contributor of the Year - Microservices

Nominated for 2022 - HackerNoon Contributor of the Year - Devops

Nominated for 2022 - HackerNoon Contributor of the Year - Api

Nominated for 2022 - Software Developer of the Year

Nominated for 2022 - HackerNoon Contributor of the Year - Software

Too Long; Didn't Read

In your car, at home, or at work — Bosch technology shapes many areas of life.

Coding with Serenade: Hands-Free Voice-Activated Programming

Coding with Serenade: Hands-Free Voice-Activated Programming

Too Long; Didn't Read

Companies Mentioned

Michael

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

Coding with Serenade: Hands-Free Voice-Activated Programming

Too Long; Didn't Read

Companies Mentioned

Michael

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

RELATED STORIES