Connect with us

Fintech

MIT Student Invents Breakthrough Art Restoration Technique | PYMNTS.com

Published

on

Ever since he was a child, Alex Kachkine has been fascinated by paintings. He would visit museums and was drawn in by the visual art depicted in landscapes, historical figures and religious scenes.

“Anytime I visit New York City, the first place I go to is the art gallery,” Kachkine said in an interview with PYMNTS. “It’s been a lifelong passion of mine.”

Such adoration naturally means Kachkine would look to acquire art works of his own. But with a limited budget, the MIT graduate researcher with a discerning eye instead bought damaged oil paintings he could restore.

“I ventured into art conservation around 10 years ago when I realized that you can’t buy a Monet reasonably,” Kachkine said. “But you can, even with the limited income I had back then, buy damaged paintings. And I realized that I could take one of those damaged paintings, restore it, and then I would have a really nice painting.”

Kachkine knew that restoration is manually laborious. The painting has to be cleaned of debris and any past restoration efforts have to be removed as well. Then, the damaged parts in paintings have to be manually painted while staying true to the artist’s style.

This typically means months to years of painstaking work. Kachkine did it the traditional way at first, but thought there must be a better way. So, he invented a method using artificial intelligence (AI), transfer paper, printers and varnish. His paper describing the technique is published in the journal Nature.

Kachkine said his method greatly speeds up restoration: In repairing a 2-foot by 2-foot painting, “The Adoration of the Shepherds,” from the late 15th century, he spent 3.5 hours compared to 232 hours it would normally take to do it manually. That’s faster by 66 times.

Source: “Physical restoration of a painting with a digitally constructed mask,” Nature

Taking the cleaning time into account, his method would speed up the entire restoration process by four to five times, Kachkine said.

Around 70% of paintings in institutional collections are not displayed in public due in part of the cost of restoring them, according to Kachkine’s paper. Therefore, restoration efforts typically center around the most valuable pieces of art with the rest left buried in storage.

Kachkine said various AI models are able to generate images of damaged paintings as they would look fully restored. But these would exist only virtually. He said his technique is the first to translate the digital restored image into physically restoring the actual painting.

“This is the first time we’ve been able to take all of those digital tools and actually end up with a physically restored painting from them,” he said. “And it’s so much faster than doing these kinds of restorations by hand.”

How Gen AI Helps Restore Paintings

The process begins with cleaning the artwork of debris and old restoration efforts. Once cleaned, the painting is scanned to produce a high-resolution image. Kachkine then uses a variety of Adobe-integrated digital tools, including convolutional neural networks and partial convolution models, to reconstruct missing regions.

Once the digital restoration is complete, a transparent film mask is printed with the reconstructed imagery. This laminate consists of nine ultra-thin layers, including a white backing for color vibrancy and laser-printed pigments. The result is an overlay that sits precisely on the original painting, with printed colors covering only the damaged areas.

“It’s thinner than human hair,” Kachkine said, adding that the film is removable using standard conservation solvents, preserving the artwork underneath.

The ethical implications of this method were also central to Kachkine’s design. He developed algorithms that determine which regions to restore based on how human vision perceives color and contrast.

“We really only select the damages that human vision is sensitive to,” he said. “You can tell what areas have been restored and which have not. That’s really important from an ethical standpoint in conservation.”

At first, Kachkine said he wasn’t sure how his method would be received. But he was gratified to see broad interest from conservators, cultural institutions and private equity firms. He also has a GoFundMe page.

Kachkine said he is now collaborating with the Italian Ministry of Culture on restoring frescoes in earthquake-damaged chapels in Tuscany.

His dream painting restoration job would come from the Italian Renaissance.

“There are a number of Italian paintings, especially around the Renaissance, that have very bright colors” such as Raphael, Kachkine said. “I’d love to be able to restore one of those [paintings] where before restoration, it would be very difficult to appreciate all of the fun colors that might emerge and the interesting textures that are there.”

“That’s the dream,” he said. “It might take a little bit before I could get my hands on one, but I’ll keep trying.”

Read more:

New AI Startup Turns a Dog’s Bark Into a Human Conversation

Meta Says Foundation Model Gives Virtual Embodied Agents Human-Like Movements

AI-Powered Digital Twins Give Clinical Trials a 75-Year Upgrade

Photo: MIT graduate researcher Alex Kachkine looking at a painting. Credit: Alex Kachkine

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Fintech

US Proposes to Expand Delivery Drone Flights  | PYMNTS.com

Published

on

The Trump administration has proposed a rule to significantly expand drone operations, which could alter America’s shopping habits, boosting retailers like Walmart and Amazon as they expand into delivering consumer packages by autonomous aircraft.

The proposal, unveiled on Tuesday (Aug. 5), aims to safely integrate drones — technically called unmanned aircraft systems — into the national airspace. Under current rules, operators must seek individual waivers for flights beyond the drone operator’s direct line of visual sight.

The Federal Aviation Administration’s (FAA) Bryan Bedford said comments accompanying the rule announcement that the “Beyond Visual Line of Sight” proposal is key to realizing drones’ societal and economic benefits.” He cited package delivery first, followed by agriculture, aerial surveying, public safety, recreation and flight testing.

An FAA fact sheet said that under the proposal, drone operations would occur at or below 400 feet above ground level, from pre-designated and access-controlled locations. Operators would need FAA approval for the areas where they intend to fly, and proposals for a single operator to fly multiple drones would be evaluated on a case-by-case basis.

Late last year, Amazon’s Prime Air drone delivery service got a boost with new drones that have double the range and half the noise of previous models.

Approved by the FAA the month before, the drones began operations in select areas of Arizona and Texas, delivering small packages weighing up to five pounds. The retail behemoth paused the aircraft for two months for a software upgrade but resumed flights in April. Amazon aims to deliver 500 million packages by drones by the end of the decade, with groceries and other retail goods on a customer’s doorstep within an hour of ordering.

In June, Walmart expanded its ultra-fast drone delivery across five states to Arkansas, Florida, Georgia, North Carolina and Texas.

Accounting firm PWC sees drones making 808 million deliveries to global consumers by 2034, at an average cost of around $2 per package. 

Continue Reading

Fintech

Household Debt Rises to $18.39 Trillion as Auto, Mortgage Originations Tick Up | PYMNTS.com

Published

on

Mortgage balances led the rise, growing by $131 billion to $12.94 trillion as housing activity remained stable despite affordability concerns. Auto loan originations also climbed, totaling $188 billion — up from $166 billion in Q1. Credit card balances rose by $27 billion, while lenders expanded aggregate credit limits by $78 billion, pointing to continued lender optimism in extending consumer credit. 

But that expansion came alongside rising signs of financial pressure. Student loan delinquencies surged as paused missed payments resumed reporting. The share of seriously delinquent student debt jumped to 12.9% — up from just 0.8% a year ago. More than 2.2 million borrowers saw their credit scores fall by over 100 points, and 1 million lost at least 150. Bloomberg Economics estimates these credit shocks could pull $63 billion in consumer spending out of the economy on an annualized basis.

Delinquency rates for mortgages and home equity lines of credit also ticked up, though performance remains strong relative to historical benchmarks. Still, rising mortgage costs have pushed 70% of households earning more than $100,000 into living paycheck to paycheck — a sharp shift in financial stability among higher-income consumers. 

As traditional credit becomes harder to manage, younger consumers are turning to alternatives. Buy now, pay later (BNPL) usage continues to rise, especially among Generation Z and younger millennials — 58% of whom now prefer BNPL over credit cards. That shift is also shaping commerce habits: 43% of shoppers now choose merchants based on whether installment plans are available.

At the same time, 69% of Gen Z consumers report living paycheck to paycheck. One in three U.S. adults also said they experience surprise expenses of several hundred dollars each year — making short-term financing tools more of a necessity than a convenience. 

Together, these trends reveal a consumer credit landscape in flux. Borrowing continues to rise, but so do the risks tied to repayment, especially for younger and mid-income households navigating higher costs and shrinking buffers.

Continue Reading

Fintech

Upstart Sees Surge in Demand for Auto and Small Dollar Loans | PYMNTS.com

Published

on

Triple-digit gains across key business segments — as measured in loan originations and revenues — were not enough to stave off a 7% drop in Upstart Holding’s shares in after-market trading on Tuesday (Aug. 5).

Company materials revealed that revenues surged 102% year on year in the second quarter, while the platform’s loan originations topped more than 372,590 in the period, up 159%. 

The data showed that as loans topped $2.6 billion, personal loan originations were up 143%. The company also noted that borrowers with super-prime FICO scores represented 26% of originations.

Upstart’s management noted on the call that other business lines such as auto-related loans also saw growth. The platform originated more than 4,600 auto loans in the second quarter, up more than 6x from a year ago and up 87% sequentially, equating to $114 million in volume. Home loans were up by 9x year on year to $68 million in originations, jumping 67% sequentially.

Management has guided to $1 billion in revenues for the current quarter, which is in line with Wall Street consensus.

Growth in Newer Business Lines

During a conference call with analysts, CEO Dave Girouard said that with respect to the auto business, “the dealership adoption right now is like nothing we’ve seen in the past, and the volume of loan requests and closed agreements from our dealer partners is on a steep climb. This is a recent phenomenon.”

Girouard said that the newer businesses in home and auto attracted almost 20% of new borrowers to the platform, including the small dollar loan product, which grew 40% sequentially, crossing more than $100 million in originations in the latest period. 

“Our growth last quarter was not a result of dramatic macro improvements or Fed rate decreases,” he said. “Our growth was primarily on the back of model improvements.”

Upstart’s models, he added, powered by AI, helped drive conversion rates from 19% in Q1 to 24% in Q2. The improvements were tied to Model 22, which the company launched in early May.

Funding Pipeline Outlook

“Our funding partnerships have been both durable and scalable, allowing us to grow rapidly while delivering the target returns our partners expect,” Girouard said. “With respect to banks and credit unions, we expect to reach a new all time high for monthly available funding in Q3, surpassing our prior peak from early 2022. The funding markets continue to improve as the year progresses, particularly since the Liberation Day fears in early April subsided.”

Added Girouard: “We’re building the ‘always on everything store’ for credit, aiming to persistently underwrite 100% of Americans.”

Upstart Co-founder and CTO Paul Gu said on the call that the model upgrades had translated into “numerous improvements and optimizations to how customers can pay, how much they pay, and when they pay. As a result, year-over-year population adjusted delinquency rates are down 20%, and raw delinquency rates are down 32%.”

CFO Sanjay Datta said in remarks on the call that “the broader macro has been idling in regards to its impact on credit trends, registering as neither a significant headwind nor tailwind over the past months.” Fee-based revenues were up 84%, he said, and was 15% better than guidance.

“Average loan size of approximately $7,570 was 15% lower than the prior quarter as model advancements drove higher approval rates in smaller loan amounts,” Datta said. Management also noted on the call that the shift to small dollar loan products also has moved to drive average loan sizes down.

Asked on the call about the competitive nature of the markets, Girouard said that the improved funding environment “does tend to bring more competitors into the space. So unsurprisingly, it’s a fairly competitive game these days … We’re very focused on having best offers both at super prime level and at our core business as well. We’re confident in our ability to grow our market share and keep our strength in those markets.”

As for the state of the consumer, Datta said: “We’ve been consistent in saying that the American consumer in aggregate is probably overspending relative to the income levels that we’re earning and that’s been true for a while now. If that balance improves, we would expect that credit trends would improve as well.”

Continue Reading

Trending