Lidiya Murakhovs'ka, Author

Lidiya's latest articles

An illustration showing screens, gears and a magnifying glass.

Blog

Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length

TLDR We trained a series of 7B LLMs named XGen-7B with standard dense attention on up to 8K sequence length for up to 1.5T tokens. We also fine tune the models on public-domain…

18 authors

Enter a valid e-mail address

Select your Country

Select a state/province

Yes, I would like to receive the Salesforce 360 Highlights newsletter as well as marketing emails regarding Salesforce products, services, and events. I can unsubscribe at any time.

I agree to the Privacy Statement and to the handling of my personal information. In particular, I consent to the transfer of my personal information to other countries, including the United States, for the purpose of hosting and processing the information as set forth in the Privacy Statement. Learn More

I understand that these countries may not have the same data protection laws as the country from which I provide my personal information. For more information, click here.

Please read and agree to the Master Subscription Agreement

By registering, you confirm that you agree to the processing of your personal data by Salesforce as described in the Privacy Statement.

New to Salesforce?

About Salesforce

Lidiya Murakhovs'ka

Lidiya's latest articles

Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length

Get the latest articles in your inbox.

360 Highlights

IT

Commerce

Marketing

Service

Sales

Thanks, you're subscribed!