Connect with us

AI

AI and Efficiency

We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less compute to train a

Published

on

We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less compute to train a neural network to the level of AlexNet (by contrast, Moore’s Law would yield an 11x cost improvement over this period). Our results suggest that for AI tasks with high levels of recent investment, algorithmic progress has yielded more gains than classical hardware efficiency.

Read Paper

Algorithmic improvement is a key factor driving the advance of AI. It’s important to search for measures that shed light on overall algorithmic progress, even though it’s harder than measuring such trends in compute.

44x less compute required to get to AlexNet performance 7 years later

Total amount of compute in teraflops/s-days used to train to AlexNet level performance. Lowest compute points at any given time shown in blue, all points measured shown in gray.

Download charts

Measuring efficiency

Algorithmic efficiency can be defined as reducing the compute needed to train a specific capability. Efficiency is the primary way we measure algorithmic progress on classic computer science problems like sorting. Efficiency gains on traditional problems like sorting are more straightforward to measure than in ML because they have a clearer measure of task difficulty. However, we can apply the efficiency lens to machine learning by holding performance constant. Efficiency trends can be compared across domains like DNA sequencing (10-month doubling), solar energy (6-year doubling), and transistor density (2-year doubling).

For our analysis, we primarily leveraged open-source re-implementations to measure progress on AlexNet level performance over a long horizon. We saw a similar rate of training efficiency improvement for ResNet-50 level performance on ImageNet (17-month doubling time). We saw faster rates of improvement over shorter timescales in Translation, Go, and Dota 2:

  1. Within translation, the Transformer surpassed seq2seq performance on English to French translation on WMT’14 with 61x less training compute 3 years later.
  2. We estimate AlphaZero took 8x less compute to get to AlphaGoZero level performance 1 year later.
  3. OpenAI Five Rerun required 5x less training compute to surpass OpenAI Five (which beat the world champions, OG) 3 months later.

It can be helpful to think of compute in 2012 not being equal to compute in 2019 in a similar way that dollars need to be inflation-adjusted over time. A fixed amount of compute could accomplish more in 2019 than in 2012. One way to think about this is that some types of AI research progress in two stages, similar to the “tick tock” model of development seen in semiconductors; new capabilities (the “tick”) typically require a significant amount of compute expenditure to obtain, then refined versions of those capabilities (the “tock”) become much more efficient to deploy due to process improvements.

Increases in algorithmic efficiency allow researchers to do more experiments of interest in a given amount of time and money. In addition to being a measure of overall progress, algorithmic efficiency gains speed up future AI research in a way that’s somewhat analogous to having more compute.

Other measures of AI progress

In addition to efficiency, many other measures shed light on overall algorithmic progress in AI. Training cost in dollars is related, but less narrowly focused on algorithmic progress because it’s also affected by improvement in the underlying hardware, hardware utilization, and cloud infrastructure. Sample efficiency is key when we’re in a low data regime, which is the case for many tasks of interest. The ability to train models faster also speeds up research and can be thought of as a measure of the parallelizability of learning capabilities of interest. We also find increases in inference efficiency in terms of GPU time, parameters, and flops meaningful, but mostly as a result of their economic implications rather than their effect on future research progress. Shufflenet achieved AlexNet-level performance with an 18x inference efficiency increase in 5 years (15-month doubling time), which suggests that training efficiency and inference efficiency might improve at similar rates. The creation of datasets/​environments/​benchmarks is a powerful method of making specific AI capabilities of interest more measurable.

Primary limitations

  1. We have only a small number of algorithmic efficiency data points on a few tasks. It’s unclear the degree to which the efficiency trends we’ve observed generalize to other AI tasks. Systematic measurement could make it clear whether an algorithmic equivalent to Moore’s Law in the domain of AI exists, and if it exists, clarify its nature. We consider this a highly interesting open question. We suspect we’re more likely to observe similar rates of efficiency progress on similar tasks. By similar tasks, we mean tasks within these sub-domains of AI, on which the field agrees we’ve seen substantial progress, and that have comparable levels of investment (compute and/or researcher time).
  2. Even though we believe AlexNet represented a lot of progress, this analysis doesn’t attempt to quantify that progress. More generally, the first time a capability is created, algorithmic breakthroughs may have reduced the resources required from totally infeasible to merely high. We think new capabilities generally represent a larger share of overall conceptual progress than observed efficiency increases of the type shown here.
  3. This analysis focuses on the final training run cost for an optimized model rather than total development costs. Some algorithmic improvements make it easier to train a model by making the space of hyperparameters that will train stably and get good final performance much larger. On the other hand, architecture searches increase the gap between the final training run cost and total training costs.
  4. We don’t speculate on the degree to which we expect efficiency trends will extrapolate in time, we merely present our results and discuss the implications if the trends persist.

Measurement and AI policy

We believe that policymaking related to AI will be improved by a greater focus on the measurement and assessment of AI systems, both in terms of technical attributes and societal impact. We think such measurement initiatives can shed light on important questions in policy; our AI and Compute analysis suggests policymakers should increase funding for compute resources for academia, so that academic research can replicate, reproduce, and extend industry research. This efficiency analysis suggests that policymakers could develop accurate intuitions about the cost of deploying AI capabilities—and how these costs are going to alter over time—by more closely assessing the rate of improvements in efficiency for AI systems.

Tracking efficiency going forward

If large scale compute continues to be important to achieving state of the art (SOTA) overall performance in domains like language and games then it’s important to put effort into measuring notable progress achieved with smaller amounts of compute (contributions often made by academic institutions). Models that achieve training efficiency state of the arts on meaningful capabilities are promising candidates for scaling up and potentially achieving overall top performance. Additionally, figuring out the algorithmic efficiency improvements are straightforward since they are just a particularly meaningful slice of the learning curves that all experiments generate.

We also think that measuring long run trends in efficiency SOTAs will help paint a quantitative picture of overall algorithmic progress. We observe that hardware and algorithmic efficiency gains are multiplicative and can be on a similar scale over meaningful horizons, which suggests that a good model of AI progress should integrate measures from both.

Our results suggest that for AI tasks with high levels of investment (researcher time and/or compute) algorithmic efficiency might outpace gains from hardware efficiency (Moore’s Law). Moore’s Law was coined in 1965 when integrated circuits had a mere 64 transistors (6 doublings) and naively extrapolating it out predicted personal computers and smartphones (an iPhone 11 has 8.5 billion transistors). If we observe decades of exponential improvement in the algorithmic efficiency of AI, what might it lead to? We’re not sure. That these results make us ask this question is a modest update for us towards a future with powerful AI services and technology.

For all these reasons, we’re going to start tracking efficiency SOTAs publicly. We’ll start with vision and translation efficiency benchmarks (ImageNet and WMT14), and we’ll consider adding more benchmarks over time. We believe there are efficiency SOTAs on these benchmarks we’re unaware of and encourage the research community to submit them here (we’ll give credit to original authors and collaborators).

Industry leaders, policymakers, economists, and potential researchers are all trying to better understand AI progress and decide how much attention they should invest and where to direct it. Measurement efforts can help ground such decisions. If you’re interested in this type of work, consider applying to work at OpenAI’s Foresight or Policy team!


Source: https://openai.com/blog/ai-and-efficiency/

AI

A Quick Guide to Conversational AI And It’s Working Process

Customer support is an integral part of every business; without offering support services, it is difficult to achieve maximum customer satisfaction. To ensure the same, […]

The post A Quick Guide to Conversational AI And It’s Working Process appeared first on Quytech Blog.

Published

on

Customer support is an integral part of every business; without offering support services, it is difficult to achieve maximum customer satisfaction. To ensure the same, businesses hire professionals who work round the clock to deliver support services. No matter how efficiently a business handles this segment, they might have to face problems such as “delay in responding customers’ queries” or “making a customer wait to connect with the support professionals”, and more.

A Conversational AI is a perfect solution to this most common challenge that manufacturing, FMCG, retail, e-commerce, and other industries are facing. Never heard of this term?

Well, this is the latest trend in almost all the industries that are already using artificial intelligence technology or wanting to adopt the same in their business operations. Let’s read about the same in detail.

What is Conversational AI?

Conversational AI is a specific kind of artificial intelligence that makes software interact and converse with users in a highly intuitive way. It uses natural language processing (NLP) to understand and interact in human language.

The conversational AI, when integrated into chatbots, messengers, and voice assistants, enables businesses to deliver personalized customer experience and achieve 100% customer satisfaction. Google Home and Amazon Echo are the two popular examples of it.

Applications of Conversational AI

Conversational AI a new and automated way of offering customer support services. Healthcare, Adtech, logistics, insurance, travel, hospitality, finances, and other industries are using technology in the following:

Messaging applications

Conversational AI can be used in a messaging application to offer personalized support services through chat. Your customers can choose the “chat support” option and talk to the chatbot to get the support.

Speech-based virtual assistants

A conversational AI can use speech recognition technology so that you can offer a speech-based virtual assistant for your customers. These are the type of chatbots where users can get any information through voice commands.

Virtual customer assistants

This type of conversational AI helps in offering online support to customers; you can develop the same to offer support through Web, SMS, messaging applications, and more.

Virtual personal assistants

A virtual personal assistant, powered by conversational AI, minimizes the need of hiring a huge team to offer dedicated support services to each of your customers.

Virtual employee assistants

Employees working in big organizations might need various types of assistants. A conversational AI used to build a virtual employee assistant can be the point of contact for all such employees. They can find the required information just by interacting with that assistant.

Robotic process automation

Robotic process automation using the potential of conversational AI helps a machine to understand human conversations and their intent to perform automated tasks.

Working of conversational AI

Machine learning, deep learning, and natural language processing are the three main technologies behind conversational AI. Here is how it works:

  1. Collection of unstructured data from various sources
  2. Data preprocessing and feature engineering
  3. Creating an AI model
  4. Training the model to automatically improve from experiences
  5. Testing the model
  6. Detecting patterns and making decisions
  7. AI deployment

What benefits businesses can get by using conversational AI?

Apart from helping businesses to deliver an unmatched customer experience, conversational AI can offer a plethora of other benefits that include:

Saves Time

Having an automated chatbot would help you save a considerable amount of time. The saved time can be used to perform other tasks or focus on your business’ marketing and promotion.

Helps in providing Real-Time Support Services

A conversational AI can handle multiple queries at one time, without even letting other customers wait. In short, every customer will feel like they are getting dedicated support services in real-time.

Improves business efficiency

With a conversational AI, you can have the assurance that your customers are being taken care of properly. In short, their queries are being handled and resolved immediately. You can focus on other segments of your business and improve efficiency.

Helps in lowering down Customers’ Complaints

Since a conversational AI can immediately respond to queries of the customers, it can help to reduce the number of complaints. Resolving customers’ complaints without making them call a support professional would increase customer loyalty and increase your brand reputation.

Increases chances of sales

By providing a persistent communication channel that precedes the context further, you can make your customers explore more and shop more. Moreover, a conversational AI can also help in reducing the cart abandonment rate as it can provide immediate assistance regarding the issues a user is facing while making the payment, applying a discount code, or at any other time.

The user would not even have to contact the support center. To understand this better, let’s take an example- a user has added one or more products to the cart, but he/she is unable to find his/her preferred mode of payment. After a few minutes, what would the customer do, either visit the contact us section to get the customer support number and connect to a professional (which is a time taking process) or simply get the support through a conversational AI. The latter would automatically send a message to the customer to ask the query and provide a resolution.

Now when you know everything about conversational AI and want to build one for you, then contact Quytech, a trusted AI app development company. Quytech has more than a decade of experience in working on artificial intelligence, machine learning, and other latest technologies.

Final Words

Are you curious to know about conversational artificial intelligence? Give this article a read to know the definition and working of conversational AI in detail. We have also mentioned the reasons why this technology is becoming the talk of the town among businesses of all sizes and types. After reading the article, if you want to develop a tailor-made conversational AI for your business, then reach out to a reliable and experienced AI development company or hire AI developers with considerable experience.

Source: https://www.quytech.com/blog/what-is-conversational-ai-and-how-does-it-work/

Continue Reading

AI

Are Legal chatbots worth the time and effort?

Published

on

KLoBot — the Best AI-Chatbot builder platform

The legal industry is always known for its resistance to change, but technology in the legal landscape has seen rapid growth from the past few years. The global Coronavirus pandemic has also accelerated the pace of investments in legal technology, which is likely to transform the legal marketplace.

Several law firms are majorly focusing on the adoption of innovative technology, which has the capability to modernize the practice of law. Innovative technologies, including Artificial Intelligence, Analytics, and Blockchain, among others, prioritizes the speed and efficiency of legal services.

Technology in the legal sector is an enabler that empowers attorneys and paralegals to perform their jobs better.

The use of AI and its applications in the legal industry is moving higher and is becoming the next big thing for legal firms. By 2024 the legal AI software market is expected to reach $1,236 million and is forecasted to grow at a CAGR of 31.3% during 2019–2024. (2)

Incorporating AI into legal practice can augment the workflows and streamline the work processes. AI-powered chatbots are disrupting the legal industry and are poised to become a preferred mode of communication for internal as well as external users. Leveraging NLP and NLU algorithm power, which are one of the prominent fields in AI, chatbots can understand intents, contexts, and further handle end to end human-machine interactions.

Law firms, as well as corporate legal departments, continue to look for new ways to enhance efficiency and drive productivity. AI-enabled chatbots are one such way that has the potential to revolutionize the law firm operations. These chatbots are a new approach for law firms to imitate human conversations and automatically respond to clients as well as attorneys’ queries.

Legal chatbots have the capabilities to make better and quicker decisions when compared to human agents. It reduces the burden on attorneys and paralegals to repetitively answer the same queries, which further brings consistency to users’ responses.

1. 8 Proven Ways to Use Chatbots for Marketing (with Real Examples)

2. How to Use Texthero to Prepare a Text-based Dataset for Your NLP Project

3. 5 Top Tips For Human-Centred Chatbot Design

4. Chatbot Conference Online

Internal Chatbots

Internal chatbots are nothing but the chatbots for internal operations and communications, helping law firms manage enterprise collaboration. Internal legal chatbots help law firms automate the contract review process, which is one of the most tedious tasks for attorneys and in-house counsel.

Legal chatbots for attorneys come with a predefined set of policies to review & analyze documents, perform due diligence, and automate other monotonous tasks that attorneys perform. Other basic tasks comprising scheduling meetings, setting up reminders, and searching relevant matter information can also be performed by legal chatbots. Internal legal chatbots empower attorneys to reduce the risk of human errors by automating the monotonous administrative chores and allow them to focus more on higher value and complicated tasks that need attorney’s intervention.

External Chatbots

External chatbots, on the other side, are the client-facing legal chatbots. These chatbots can draft the legal documents, including UCC filings, divorce forms, and other non-disclosure agreements based on the client inputs.

External legal chatbots empower law firms to handle the client intake process efficiently and generate leads, which further reduces an attorney’s time spent on these activities.

In the current scenario of receiving information instantly at a fingertip, legal chatbots serve as the best solution to handle client queries and provide legal advice.

External, as well as internal legal chatbots with their 24/7 supporting abilities, facilitate law firms to manage operational costs and meet the evolving client expectations.

Although chatbots are taking time to augment legal services but are worth the effort.

KLoBot is an incredibly intelligent AI chatbot builder platform that allows legal firms to create text and voice-based chatbots within minutes. KLoBot’s easy drag and drop skill interface helps law firms to design no-code chatbots that can be deployed across an organization’s favorite channels. The chatbots built on the KLoBot platform help law firms perform simple and complex routine tasks, including QnA and knowledge repository search. Few other jobs, including scheduling meetings, setting up reminders, completing actions on behalf of attorneys, finding colleagues, assisting attorneys, and much more, are also being performed by KLoBot enabled chatbots.

KLoBot enabled chatbots to act as a personal assistant and enhance attorneys as well as client experiences. These chatbots empower law firms to simplify internal as well as external communications and streamline business processes.

KLoBot AI chatbots with its feature-rich admin console, provide law firms robust security controls. To know more about KLoBot click here.

References

[1] The Law Society Capturing Technological Innovation in Legal Services Report

[2] https://www.marketsandmarkets.com/

Source: https://chatbotslife.com/are-legal-chatbots-worth-the-time-and-effort-5f44936f7e89?source=rss—-a49517e4c30b—4

Continue Reading

AI

Things to Know about Free Form Templates

A single file that includes numerous supporting files is commonly known as a form template. Some files will define or show the controls to appear on the free form templates or design. The collections of these supporting files or templates are also called form files. While designing free form templates, users should be able to […]

The post Things to Know about Free Form Templates appeared first on 1redDrop.

Published

on

A single file that includes numerous supporting files is commonly known as a form template. Some files will define or show the controls to appear on the free form templates or design. The collections of these supporting files or templates are also called form files. While designing free form templates, users should be able to view and also work with the form files. 

It will create a new free form template by copying and storing those files within a folder. A form template (.XSN) file designing or creation of a single file will include various supporting files. Users may fill out the online form by accessing the .XML form file, which is a form template.

Designing Free Form Templates

There are numerous processes that define free form template design, and are as follows:

  • Designing the form’s appearance – the instructional text, labels, and controls
  • Controls will assist with user interaction behavior on the form template. You can design a specific section to appear or disappear when the user chooses a particular option
  • Whether the form template may include some additional views. For a permit application form design, for example, you have to provide different views for each person. One view especially for the electrical contractor, next for the receiving agent, and finally, the investigator. He or she will deny or approve the permit application
  • Next, you need to know how & where to store the form data. Designing free from templates will allow users to submit their data within the database either online or direct access. If not, they can also store the same in any specific shared folder
  • It is essential to design the other elements, colors, and fonts within the form template
  • Users must be able to personalize the form. Allowing users to include various rows within the optional section, repeating section, or a repeating table
  • Users should receive a notification when they forget to input a mandatory field or make mistakes within the form
  • After completing the free form templates design, you can publish the same online using a .XSN file format

Club Signup Form

A simple registration form can help your Club Signup Form creation process go smoother. This signup form could be an ideal solution for a new club membership registration for any organization or club.

Application Form

Application form templates are much easier to use & set-up to streamline your application process. You can customize this online form and utilize the same for numerous applications. Make use of this application form as a job application form, volunteer applications, contest entries, or high school scholarship applications. It is an ideal solution for scholarship programs, nonprofit organizations, business owners, and many such users and use cases.

Scheduling Form

Scheduling form templates are handy and can be used for numerous appointment booking requirements. A scheduling form is also utilized for various appointment scheduling or online reservations and booking purposes. Regardless of your business requirement, it is easy to customize the form template.

Concept Testing Survey

While testing a new design or concept, it is essential to gather the responses quickly. Freeform templates for a concept testing survey make it much easier to gather product feedback and reach the target audience. It is essential to conduct market research while planning to release a new product. A mobile-friendly form will allow you to utilize the survey questions for collecting the product’s consumer input quickly.

Credit Card Order Form

It is not always a complex process to provide an online credit card payment form for the customers. This form template will allow you to access numerous services or products for collecting card payment information. You can utilize this yet-another endless and simple payment form.

Employment Application Form

The employment application form for recruitment will assist the HR team to gather the required information from candidates. During the interview or application process, you can easily remove any expensive follow-ups. Some of the fields are contact information, employment history, useful information, etc. as well as an outline of the job description, consent for background checks, military service record, anticipated start date, any special skills, and many more. It is optional to enable notifications for the form owners to receive an alert or email when a new employment application is submitted.

Source: https://1reddrop.com/2020/10/24/things-to-know-about-free-form-templates/?utm_source=rss&utm_medium=rss&utm_campaign=things-to-know-about-free-form-templates

Continue Reading
AI16 mins ago

A Quick Guide to Conversational AI And It’s Working Process

AI1 hour ago

Are Legal chatbots worth the time and effort?

AI2 days ago

Things to Know about Free Form Templates

AI2 days ago

Are Chatbots Vulnerable? Best Practices to Ensure Chatbots Security

AI2 days ago

Best Technology Stacks For Mobile App Development

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

AI3 days ago

Arcanum makes Hungarian heritage accessible with Amazon Rekognition

Trending