Over a year ago, I wrote about the potential of new chatbot blockchain digital autonomous organizations. I was excited about the possibilities of how the emerging technologies of chatbots and blockchains would merge to create the digital autonomous organizations and what this could mean for delivering government services. Since then, 2017 has being called the “Year of the Chatbot” because of the rapid advances in artificial intelligence (AI) and the explosion of tools that make it easy to create chatbots.
The Data Briefing
Learning—and practicing—five imperatives of network leadership can help agencies improve their odds for successful digital transformation. Many organizations are undergoing digital transformation because the organizations see that it is necessary for long-term survival. However, digitally reinventing the organization is “one of the hardest journeys to make.” According to industry experts, two-thirds of organizations will fail at digital transformation. With these dismal odds, what can agency leaders do to improve their agency’s chances in successfully digitally transforming?
Since 2007, a major consulting firm has conducted an annual survey on organizations’ “Digital IQ.” In the ten years of organizations grappling with digital transformation, what has been learned? From the report: Focus on the human experience [emphasis in the original]: Rethink how you define and deliver digital initiatives, consider employee and customer interactions at every step of the way, invest in creating a culture of tech innovation and adoption, and much more.
It’s been a while since I’ve checked in on enterprise architecture (EA). My last in-depth work with EA was around 2011 when I was on detail to the Office of Personnel Management’s Open Government Team. The EA model I worked with was the top-down organizational design of information technology assets, data assets, and business processes. Many of you are probably familiar with this traditional EA model. Six years later, it is predicted that in 2018 that “half of enterprise architecture (EA) business architecture initiatives will focus on defining and enabling digital business platform strategies.
Forbes magazine recently ran an article showcasing six handy mobile apps that were built using federal government open data. The apps range from the Alternative Fueling Station Locator to ZocDoc (a doctor locator). What I especially like about the Forbes article is that the author describes the federal government data sets behind each app. There are many more mobile apps built by federal government agencies or using federal government data sources.
You may have heard of “serverless architecture” or Amazon Web Services (AWS) Lambda product and wondered what is unique about this new buzzword. As with many new digital cloud technologies, serverless architecture could mean two things. It may be applications that are built using third-party cloud applications. Or serverless architectures could be pieces of code that live in the cloud and only run when called on by a user: event-driven functions.
This week, I want to briefly discuss the human resources challenges in finding the new IT technology workers for the government. As agencies move toward microservices, artificial intelligence chatbots, and deep learning application programming interfaces (APIs), the demand for experts in these fields continues to grow fast. The universities and professional development programs are not churning out the talent fast enough while governments are competing with private industry for what experts are currently available.
The open source movement has changed how we develop software, create content, and even do science. Using a community to help complete projects and bring about change has become so ubiquitous in the last ten years that it has even earned a name — crowdsourcing. Crowdsourcing is a powerful tool and is now being used to help organizations digitally transform. “Driving successful change in a large organization has always been one of the most difficult activities in business… .
As the Federal government agencies begin the digital transformation journey, becoming a data-driven organization is even more vital. What does it mean to become a data-driven organization? According to one definition, “[a] data-driven company is an organization where every person who can use data to make better decisions, has access to the data they need when they need it.” There are many theories are on how to create a data-driven organization, but few case studies that demonstrate the actual process.
A recent study of big data initiatives in 65 cities has interesting guidance for Federal big data initiatives. The researchers studied how data is collected and then used for decision making in what they called “the framework for Big Data initiatives.” There are two major cycles in the framework: “The data cycle governs the tools and processes used to collect, verify, and integrate data from multiple sources. Because of the variety of data sources involved, data teams in this cycle are [sic] often composed of representatives from multiple departments to leverage their field expertise and insider understanding of the data.
In December, I plan to write two postings detailing a scenario analysis for the next ten years of the Federal government’s data technologies. Governments are on the cusp of amazing technological advances propelled by artificial intelligence, blockchain technologies, and the Internet of Things. Also, governments will face new challenges such as the recent global cyber attack that took down Twitter and Netflix. I want to invite you, the reader, to also send in your predictions for the future of Federal government data.
The Data Briefing: Using Artificial Intelligence to Augment the Work of Frontline Government Employees
You have probably read about the recent release of the White House’s report on using artificial intelligence (AI). As with previous technologies, AI holds much promise in the areas of education, commerce, criminal justice, the environment—almost all aspects of the American public’s life. AI also poses a danger if it is not properly managed and controlled. This is why the report advises that “[a]s the technology of AI continues to develop, practitioners must ensure that AI-enabled systems are governable; that they are open, transparent, and understandable; that they can work effectively with people; and that their operation will remain consistent with human values and aspirations.
I recently sat down with Michelle Earley, Program Manager, to discuss the new changes for the 20th anniversary of USAJOBS. 1) What are the three big lessons learned from 20 years of building and managing USAJOBS? I think one of the greatest benefits of being an Agile program is that we are constantly learning. In 2013, our team implemented the first phase of the data warehouse which provided agencies with data that could be leveraged to improve recruiting efforts.
The Data Briefing: The Federal Data Cabinet—Promoting Data Literacy, Cultural Change, and the Federal Data Applications Ecosystem
Last Wednesday, the White House held the first Open Data Summit to showcase the open data accomplishments of the Obama Administration. One of the highlights was the formation of a government-wide “data cabinet.” Announced by Chief Data Scientist DJ Patil, the data cabinet is essentially a community of practice comprising the Federal agency’s data professionals. As Dr. Patil explains, the real issues concerning technical projects revolve around cultural issues. I couldn’t agree more.
One day, at an unnamed agency, the Outlook server crashed. The server stayed down for the rest of the afternoon. Deprived of email and meeting calendars, employees wandered around trying to remember what meetings they had to attend. Other employees went searching for people who they ordinarily would email. There was confusion that made people realize just how dependent they were on a single software program. As the Federal government moves toward digital transformation, I have been thinking about how agencies can best weather the transition from legacy systems to cloud-based, agile applications.
The United Kingdom’s (UK) Digital Service has researched ways to increase data science literacy among the UK public service. Data science literacy goes further than data literacy, in that civil servants will know how to apply data science concepts and methods in their everyday work. I thought it would be useful to share the UK Digital Service’s findings to help federal government employees develop their data science literacy. Before discussing how to increase the data science skills of federal employees, let’s discuss why.
The Data Briefing: Harnessing the Internet of Things and Synthetic Data to Provide Better Flood Warnings and Prevent Veterans Suicides
Two significant items in federal government data in the last few weeks: The Department of Commerce releases the National Water Model. The National Water Model provides a comprehensive model of river flows so local communities can better prepare for possible flooding events. What is especially amazing about the National Water Model is that it pulls data from over 8,000 stream gauges. Stream gauges are automated measuring stations that measure water flow, height, surface runoff, and other hydrological data.
The Data Briefing: Microservices and Serverless Apps — A New Direction for Federal Government Mobile Apps?
Continuing from last week’s column on DevOps and containers, I will explain two other hot trends in IT — microservices and serverless apps. For those who want official federal government guidance, the National Institute of Standards and Technology (NIST) has released a draft special publication on microservices, application containers, and system virtual machines (PDF, 660 kb, 12 pages, February 2016). I wrote about microservices and containers in February 2015 as two API* trends to watch.
The Data Briefing: DevOps and Containers and Why They Are Important to Transforming Federal Government IT
You may have heard about “DevOps” in the news or when meeting with IT professionals. What exactly is DevOps and what, if any, connection does it have with agile? Also, what do “containers” have to do with all of this? In this week’s column, I will introduce DevOps and a related technology: containers. Some DevOps practitioners will argue with my interpretations, and I invite these practitioners to explain their perspectives in the comments.
The Data Briefing: FINDing Great Global Development Data Visualizations Courtesy of the State Department
Federal agencies have been releasing some fascinating data visualization tools in the last year. Recently, the State Department unveiled the Beta version of FIND or the “F Interagency Network Databank.” From the description in the FAQ: “The F Interagency Network Databank (FIND) is an online tool that enables users to explore and analyze national level data, and then share what they discover. FIND was designed around the needs of U.
The Census Bureau conducts more surveys than just the Constitutionally-mandated Decennial Census. There is also the American Community Survey, the Economic Census, the County Business Patterns series, statistics on Nonemployer businesses, and the Survey of Business Owners and Self-Employed Persons. On their own, each survey is full of useful information for researchers, local and state governments, and entrepreneurs. However, how valuable would the data be if it were mixed and displayed geographically?
While you are outside hunting Pokemon or helping your children hunt Pokemon, consider adding another mobile app to your smartphone or tablet. The Federal Emergency Management Agency (FEMA) mobile app alerts you about severe weather and other natural disasters. The app is also a great information resource on surviving disasters and connects you to FEMA for immediate assistance. A feature you won’t find in many other apps is the ability for users to crowdsource photos of disaster areas to help first responders.
The debate between responsive websites and mobile apps took a decisive turn this week when the United Kingdom’s Digital Service (UKDS) banned the creation of mobile apps. In an interview with GovInsider, the founder of UKDS, Ben Terrett, explained that mobile apps were too expensive to build and maintain. Responsive websites were easier to build and updating the application only requires changing one platform. “For government services that we were providing, the web is a far far better way… and still works on mobile,” Terrett said.
It is at the intersections of fields where you find the most fascinating and innovative concepts. Recently, a conference on “Open Human Resources and the Cognitive Era” explored the use of chatbots and blockchain technologies in human resources. Human Resources (HR) is quietly undergoing a revolution as many HR practitioners are transforming HR by using open source concepts. It is fascinating to see how cognitive technologies and cloud technologies are changing HR from a transactional and compliance function to an essential strategic organizational asset.
Business processes have fascinated me since I took an undergraduate philosophy course in modern business management. A part-time professor who was a management consultant by day taught this unusual class. Perhaps business management thinking was first experimenting with ideas that would later lead to the agile and lean movement today. From this class I learned that nearly all organizational issues could be traced back to bad processes rather than poor workers.
Few other federal agencies deal with as much data as the National Aeronautics and Space Administration (NASA). Big science creates big data, and NASA manages many of the biggest science projects in world history. Even in the early days of NASA’s history, NASA pioneered new ways to create and store data. So, in the world of the cloud, Internet of Things, and intelligent agents, how does NASA deal with its big data needs?
Cognitive computing has been receiving a good deal of attention lately as more companies have been building intelligent agents. Ever since IBM Watson’s 2011 appearance on Jeopardy, cognitive computing has spread into healthcare, investing and even veterinary medicine. However, it is only recently that cognitive computing has spread into government applications. As the name implies, cognitive computing is where computers operate much like the way people think. Computers use data mining techniques, pattern recognition algorithms and natural language processing to search a large set of unstructured data to find solutions.
My first column when I came back from last year’s summer sabbatical was on the U.S. Patent and Trademark Office’s (USPTO) PatentsView project. PatentsView became one of the Department of Commerce’s most viewed apps in 2015. Building on this success, USPTO released a beta version of its open data portal. The USPTO open data portal is divided into four different sections. The first section leads to patent and trademark datasets.
USAGov recently released a list of six great federal government mobile apps. There were many apps released by the federal government over the last 5-6 years on a wide range of topics and services. Many are well-designed and useful to the American public. So, what are the outstanding federal government apps for 2016? The Department of State’s Smart Traveler. First launched in 2011, this mobile app helps international travelers find U.
Last month, I worked to create a “Citizen Science Passport” for the federal agencies participating in the USA Science and Engineering Festival. Seven federal agencies offered some form of crowdsourcing or citizen science activity at their booths such as the U.S. Department of Agriculture’s exhibit on food safety or Environmental Protection Agency’s build-your-own air monitoring kit. Attendees would participate in each of the agency’s citizen science activity to receive a stamp on their passport.
There are many scary tales in the world of knowledge management and data management. Tales of missing data that was lost through the administrative cracks, such as the story of the missing Apollo 11 moonwalk tapes that most likely were erased by accident. Or the 36-year search for the original Wright Brothers’ patent, which was happily re-discovered this month. As more data is being created at ever-increasing speed and complexity, there will be more missing data horror stories.
Ten months ago, I wrote about the rise of the post-app world in which mobile personal assistants would do the work of five to 10 apps combined. These mobile personal assistants, now known as chatbots, would work through conversational interfaces (voice and instant messaging, for example). The idea is to build more natural interfaces for people to access information services and perform complicated online tasks. Facebook has now joined in the new conversational commerce marketspace along with Google and Apple.
It has been over seven years since President Obama signed the executive order that launched the federal open data movement. Much progress has been made, and there is still more to do. Along with the United States, over 100 nations have started programs to provide open access to government data. From large metropolitan governments to small cities, governments are opening up their data to provide better transparency and better delivery of government services.
The Office of Personnel Management released a new look and functionality to USAJOBS in February. I recently contacted Michelle Earley, the USAJOBS Program Manager, to ask about the changes to USAJOBS and the data it provides. 1. What are the priorities this year for the USAJOBS team and the site? “The priorities for this year include: Unifying the experience Incorporating a comprehensive content strategy to transform the readability of the website Improving the Job Opportunity Announcement (Represents the agency) Improving the User Profile (Represents the job seeker/applicant) Improving Search, which is the mechanism that brings together the job seekers and agencies USAJOBS hopes to continue to act as a trusted public service career platform that creates a responsive and transparent experience for its users.
Three recent stories demonstrate how opening up federal government data and using agile methods to create federal government software can spur innovation while saving tax money and helping the American public. In its Second Open Government National Action Plan (PDF, 639 KB, 5 pages, September 2014), the White House called for a government-wide policy on open source software. Recently, the Office of Management and Budget released a draft policy “to improve the way custom-developed government code is acquired and distributed moving forward.
Open data and APIs* have not only transformed the federal government; open data and APIs are also transforming tribal, state and local governments. Like federal agencies, some tribal, state and local governments are ahead of other governments in open data innovations. This situation reminds me of my earlier work with the Office of Intergovernmental Affairs in the General Services Administration. In 1998, I was a Presidential Management Fellow working on a project to catalog how state and local governments were using websites to deliver government information and services.
The increasing sophistication of mobile devices has created many opportunities for developers. Thanks to APIs* and open data, developers can build thousands of mobile apps and mobile websites to meet users’ needs. This opportunity has created one of the most contentious debates in the mobile development community: mobile apps versus mobile websites? There is, yet, no solution to the debate. However, there are some advantages and disadvantages to both types of mobile solutions.
Citizen developers are people who do not work in information technology (IT) but have built IT applications. Back in the mid-80s, business people would smuggle in personal computers to run their spreadsheets and word processing applications (anyone remember VisiCalc and Bank Street Writer?) instead of having to rely on data processing departments. Today, citizen developers use no-code or low-code services such as IFTTT (If This Then That) or QuickBase to build their business apps.
Algorithms are becoming more important as the amount of data grows, and the complexity of government and business processes grows. Put simply, an algorithm is just a set of steps for solving a problem. If you shop online, use an online social network or a mobile app to plan your route, then you are using an algorithm: A sophisticated algorithm that uses large amounts of data to make hundreds (or thousands) of decisions in milliseconds.
For many agencies, what data to make open is left up to the agency’s judgment. This has worked well as agencies do a good job in understanding the public’s needs for specific datasets. Even so, as developers and citizens begin using the open datasets, there is increasing demand for specific agency datasets. The issue is how to best accommodate those requests given the constraints of agency budgets and open data support staff.
The Congressional Research Service recently released a report (PDF, 688 kb, 17 pages, January 2016) describing the big data ecosystem for U.S. agriculture. The purpose of the report was to understand the federal government’s role in emerging big data sources and technologies involved in U.S. agriculture. As the report author, Megan Stubbs, points out, there is not even a standard definition of big data. “Big data may significantly affect many aspects of the agricultural industry although the full extent and nature of its eventual impacts remain uncertain.
Federal agencies are doing well in fulfilling the 2012 Digital Government Strategy by providing numerous mobile apps for American citizens. According to a report from IBM’s Center for the Business of Government, 76 federal agencies have at least one mobile app. As of July 2015, there are nearly 300 federal government mobile apps that provide at least one of the following: General information and news services Client services such as providing and processing government forms Crowdsourcing Health and safety information Educational services According to the report, mobile devices were one-third of the traffic to government websites, as of July 2015.
Many IT pundits predict 2016 will be a major tipping point in data and related technologies. Here are just a few predictions: 1) The Internet of Things—The number of devices that can connect to the Internet increases, especially in consumer electronics. Also, the number of sensors will dramatically increase providing more real-time data on weather, electrical power usage, and similar data. The number of devices connected to the Internet is projected to exceed the number of human Internet visitors.
Some highlights from the recent fall conference of the Association for Public Policy Analysis and Management: Localities that receive disaster mitigation funds also have more disaster declarations. Longer, more detailed proposed regulations receive fewer challenges to implementing the regulation. Agencies that are better at quantifying their results are safer from budget cuts. The findings above were all based on ready access to open government data. In fact, many more public policy and administration scholars can do more detailed, and innovative research thanks to federal agencies’ release of these datasets.
Recently, DigitalGov devoted an entire month to exploring how good user experience (UX) helps government design better digital products and services. UX is the art and science of understanding how people will use a website or mobile app to solve a problem or meet a need. UX is a combination of neuroscience, communication theory, information architecture, content strategy, graphic design, and responsive programming to build an experience that is inviting and beneficial to users.
The Smithsonian Institution’s Air and Space Museum just released a new educational mobile app, Mobile Missions. From the website: “Find out if you are cut out for a career in aerospace with our free mobile app, Mobile Missions. Take our quiz to discover the best aerospace career for you. Explore objects from our collection related to your chosen profession. Answer challenge questions to receive in-app badges and rewards. Document your journey by inserting your selfie into a historical image related to your aerospace career and share with friends.
Pop quiz on statistics and data science (answers at the end of the article): 1) I have some data on accidents at railroad crossings. One variable indicates the compass direction a railroad crossing faces (North, Northwest, Northeast, and so on). This variable is a/an: Ordinal Categorical Directional Interval 2) I have some ordinal data that I want to analyze for trends.
A month ago, I wrote about the White House’s call for data scientists and app developers to come together to help combat suicide. On December 12, 2015, there will be five hackathons around the U.S. to #HackSuicide. All the hackathons are free and open to the public. Even if you are not a data scientist, app developer or mental health expert, you may want to attend one of the events to learn how data can be used to solve a vital public health issue.
Some of you may remember when President Reagan opened America’s Global Positioning System (GPS) data. President Reagan gave all countries access to the GPS data in response to the Soviet Union shooting down Korean Airlines Flight 007 on September 1, 1983. I do not believe that the U.S. realized how much opening up GPS data would revolutionize the world economy, health services, travel and almost every other aspect of daily life.
Standing on the corner, waiting in the rain, I swear I’ll never, ever, use that app again. Why? Because the bad user experience (UX) design was preventing me from determining when the Metrobus would arrive. UX is everything from the visual design to the navigation structure of the website or mobile app. This month, DigitalGov is focusing on UX design. Good UX design is based on understanding how people perceive and process information on everything from websites to mobile apps.
By the time this is published, the United States, along with 160 other countries, will be celebrating Global Entrepreneurship Week (November 16th through November 22nd). November is also National Entrepreneurship Month with November 17th being National Entrepreneurs’ Day. As President Obama stated in his proclamation: “In keeping with our goal of fostering economic growth through private-sector collaboration, the federal government is accelerating the movement of new technologies from the laboratory to the marketplace, increasing access to research awards for small businesses, making more data open to the public [emphasis mine] and catalyzing new industry partnerships in critical fields such as advanced manufacturing and clean energy.
I (virtually) attended the Third Annual Safety Datapalooza last Thursday and was greatly impressed by the projects and initiatives for public safety. This was a great event, and I am glad that live streaming was provided for those who could not attend in person but have a great interest in using government data for disaster preparedness. If you have not already visited disasters.data.gov, please do. It is a great portal for data, apps, and tools for developers who want to help build vitally-needed public safety resources.
Have you worked with an employee with a disability? Are you an employee with a disability? Then, you know the unique challenges of the average workplace that able-bodied colleagues may never experience. Workplace challenges could be overcome with accommodations such as larger computer monitor displays, wheelchair-accessible office furniture or a voice reader. In some cases, a mobile app is a solution to a workplace challenge. October is National Disability Employment Awareness Month.
DigitalGov’s theme this month is mobile moments, which explores the impact of mobile applications in the federal government. For this post, I am examining the more than 300 mobile apps created by the federal government. An updated list of federal mobile apps is on USA.gov. According to the list, 73 federal organizations have released mobile apps on a wide variety of topics. The National Oceanic and Atmospheric Administration has the most mobile apps with 31 releases.
The Data Briefing: White House Asks Data Scientists and App Developers to Help Suicide Prevention Efforts
The White House issued a call on September 30, 2015, for data scientists and app developers to help with a vital public health issue: suicide prevention. From the official announcement: “If you are a data scientist, analyst, tech innovator, or entrepreneur interested in sharing ideas and resources for suicide prevention, we want to hear from you! Please send a brief note about your ideas and resources to mbasco[at]ostp.
OpenNASA has recently completed another redesign of their site. With over 31,000 data sets, 194 code repositories and 36 APIs, OpenNASA probably has the largest collection of open data of any of the federal agencies. An especially helpful feature is a set of icons devoted to five types of visitors: the Citizen Scientist, the Developer, the Citizen Activist, the Govvie and the Curious. A great feature to engage NASA’s audience is the Data Stories section where people talk about the projects they created with NASA datasets.
The Data Briefing: Surrounded by Fields of Federal Data—U.S. Patent and Trademark Office’s PatentsView
Hello, everyone. My summer sabbatical was short but educational, and I am glad to be back in the federal government. I am also excited to again take up the weekly API article that is now expanded to include all things federal government data. Much has happened in the open data realm, and there is much to chronicle as government uses data in more innovative ways. On my sabbatical reading stack was “Code Halos: How the Digital Lives of People, Things, and Organizations are Changing the Rules of Business.