A Scalable Hierarchical Distributed Language Model

No abstract is available for this paper.

• Publication year

  2008

• Venue

  Neural Information Processing Systems

• Publication date

  2008-12-08

• Fields of study

  Computer Science

• Identifiers

  No identifiers available.

• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Three new graphical models for statistical language modelling

  2007influential reference
• Hierarchical Probabilistic Neural Network Language Model

  2005influential reference
• A Neural Probabilistic Language Model

  2003cited by this paper
• Quick Training of Probabilistic Neural Nets by Importance Sampling

  2003cited by this paper
• Using a connectionist model in a syntactical based language model

  2003cited by this paper
• Connectionist language modeling for large vocabulary continuous speech recognition

  2002cited by this paper
• A bit of progress in language modeling

  2001cited by this paper
• Book Reviews: WordNet: An Electronic Lexical Database

  1999cited by this paper
• An Empirical Study of Smoothing Techniques for Language Modeling

  1996cited by this paper
• Improving Statistical Language Model Performance with Automatically Generated Word Hierarchies

  1995cited by this paper
• Class-Based n-gram Models of Natural Language

  1992cited by this paper

• Gradient Inversion of Text-Modal Data in Distributed Learning

  2025cites this paper
• Word2State: Modeling Word Representations as States with Density Matrices

  2025cites this paper
• Advances in Unsupervised Relation Extraction for Big Data Analytics

  2025cites this paper
• XL-HQL: A HQL query generation method via XLNet and column attention

  2025cites this paper
• Language Models Are Implicitly Continuous

  2025cites this paper
• PHyCLIP: ℓ1-Product of Hyperbolic Factors Unifies Hierarchy and Compositionality in Vision-Language Representation Learning

  2025cites this paper
• Evaluating link prediction: new perspectives and recommendations

  2025cites this paper
• VQ-Logits: Compressing the Output Bottleneck of Large Language Models via Vector Quantized Logits

  2025cites this paper
• Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations

  2025cites this paper
• Semantic Encoding Algorithm for Classification and Retrieval of Aviation Safety Reports

  2025cites this paper
• Cross-Lingual Embedding Clustering for Hierarchical Softmax in Low-Resource Multilingual Speech Recognition

  2025cites this paper
• Real-time Load Balancing Strategies for High-Throughput AI Systems

  2025influential citation
• Link prediction for multi-layer and heterogeneous cyber-physical networks

  2024cites this paper
• A Novel Deeply-Learned Image Quality Analysis Algorithm for Clustering

  2024cites this paper
• HetHub: A Heterogeneous distributed hybrid training system for large-scale models

  2024cites this paper
• Mineral Prospectivity Prediction Based on Self-Supervised Contrastive Learning and Geochemical Data: A Case Study of the Gold Deposit in the Malanyu District, Hebei Province, China

  2024cites this paper
• GeoDecoder: Empowering Multimodal Map Understanding

  2024cites this paper
• HETHUB: A Distributed Training System with Heterogeneous Cluster for Large-Scale Models

  2024cites this paper
• Multi-type and fine-grained urban green space function mapping based on BERT model and multi-source data fusion

  2024cites this paper
• Employing CNN with Spatial Pyramid Pooling for Predicting Software Defects through Image Analysis

  2024cites this paper
• Emotional Polarity Attention Mechanism for Text Sentiment Analysis

  2024cites this paper
• LLMs learn governing principles of dynamical systems, revealing an in-context neural scaling law

  2024cites this paper
• Adaptive Softmax Trees for Many-Class Classification

  2024cites this paper
• Real-Time Weather Data Analysis for Disaster Management and Response

  2024cites this paper
• Development of Classification Method for Lecturer Area of Expertise Based on Scientific Publication Using BERT

  2024cites this paper
• Fake News Detection Using Supervised Binary Classification Techniques

  2024cites this paper
• Whole Time-Series Clustering by Embedding Relational Graphs into Vector Spaces Using DeepWalk

  2024cites this paper
• Optimizing Probabilistic Box Embeddings with Distance Measures

  2024cites this paper
• Towards Amazigh Word Embedding: Corpus Creation and Word2Vec Models Evaluations

  2023cites this paper
• Word Embeddings as Statistical Estimators

  2023cites this paper
• Efficient Tree Policy with Attention-Based State Representation for Interactive Recommendation

  2023cites this paper
• Global Hierarchical Neural Networks using Hierarchical Softmax

  2023cites this paper
• An adaptive hierarchical loss for taxonomic labels and its application for plant identification

  2023cites this paper
• Large Language Models Are Zero-Shot Time Series Forecasters

  2023cites this paper
• Computing recommendations from free-form text

  2023cites this paper
• Inaccessible Neural Language Models Could Reinvigorate Linguistic Nativism

  2023cites this paper
• Deep Learning for Natural Language Processing: A Survey

  2023cites this paper
• Sentiment analysis of food safety internet public opinion based on XLNet

  2023cites this paper
• Efficient Interactive Recommendation via Huffman Tree-based Policy Learning

  2023cites this paper
• Transformer With Linear-Window Attention for Feature Matching

  2023cites this paper
• Improving Neural Models for Natural Language Processing in Russian with Synonyms

  2023cites this paper
• The Role of Codeword-to-Class Assignments in Error-Correcting Codes: An Empirical Study

  2023cites this paper
• Rethinking representations: A log-bilinear model of phonotactics

  2023cites this paper
• Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

  2023cites this paper
• Fusing external knowledge resources for natural language understanding techniques: A survey

  2023cites this paper
• In-Context Learning for Few-Shot Molecular Property Prediction

  2023cites this paper
• Deep Learning-Based Sentiment Classification: A Comparative Survey

  2023cites this paper
• Zoo guide to network embedding

  2023cites this paper
• A transformer-based neural network framework for full names prediction with abbreviations and contexts

  2023cites this paper
• HFMRE: Constructing Huffman Tree in Bags to Find Excellent Instances for Distantly Supervised Relation Extraction

  2023cites this paper
• C2FAR: Coarse-to-Fine Autoregressive Networks for Precise Probabilistic Forecasting

  2023cites this paper
• Character-Level Chinese Backpack Language Models

  2023cites this paper
• Chinese Text Sentiment Classification Based on LSTM Word-Tag Relational Network Model

  2023cites this paper
• adSformers: Personalization from Short-Term Sequences and Diversity of Representations in Etsy Ads

  2023cites this paper
• Towards Learning Generalizable Code Embeddings Using Task-agnostic Graph Convolutional Networks

  2022cites this paper
• Leveraging Sequential Nature of Conversations for Intent Classification

  2022cites this paper
• Learning to Dequantise with Truncated Flows

  2022cites this paper
• A Multi-Granular Aggregation-Enhanced Knowledge Graph Representation for Recommendation

  2022cites this paper
• Improving NMF clustering by leveraging contextual relationships among words

  2022cites this paper
• A Survey of Social Network - Word Embedding Approach for Hate Speeches Detection

  2022cites this paper
• Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Survey

  2022cites this paper
• Extreme Automatic Plant Identification Under Constrained Resources

  2022cites this paper
• Multi-sensor Data Fusion and Feature Extraction for Cutting Tool Condition Monitoring: A Review

  2022cites this paper
• Text sentiment analysis based on two-channel joint model

  2022cites this paper
• Speeding-up one-versus-all training for extreme classification via mean-separating initialization

  2022cites this paper
• Learning Context-Aware Service Representation for Service Recommendation in Workflow Composition

  2022cites this paper
• Benchmarking and Analyzing Unsupervised Network Representation Learning and the Illusion of Progress

  2022cites this paper
• Estimating word co-occurrence probabilities from pretrained static embeddings using a log-bilinear model

  2022cites this paper
• A Survey on Word Meta-Embedding Learning

  2022cites this paper
• Gender Bias in Meta-Embeddings

  2022cites this paper
• Open-vocabulary Attribute Detection

  2022cites this paper
• Session-based News Recommendation from Temporal User Commenting Dynamics

  2022cites this paper
• Identifying stimulus-driven neural activity patterns in multi-patient intracranial recordings

  2022cites this paper
• Distributed Representations of HTML Page

  2022cites this paper
• Unsupervised Alignment of Distributional Word Embeddings

  2022cites this paper
• Building an enhanced sentiment classification framework based on natural language processing

  2022cites this paper
• M-DA: A Multifeature Text Data-Augmentation Model for Improving Accuracy of Chinese Sentiment Analysis

  2022cites this paper
• Establish a patent risk prediction model for emerging technologies using deep learning and data augmentation

  2022cites this paper
• RAT: Reinforcement-Learning-Driven and Adaptive Testing for Vulnerability Discovery in Web Application Firewalls

  2022cites this paper
• The importance of Term Weighting in semantic understanding of text: A review of techniques

  2022cites this paper
• A novel knowledge graph embedding based API recommendation method for Mashup development

  2021cites this paper
• Self-training For Pre-training Language Models

  2021cites this paper
• Enabling Efficiency-Precision Trade-offs for Label Trees in Extreme Classification

  2021cites this paper
• Statistical embedding: Beyond principal components

  2021cites this paper
• Research on Multi-granularity Ensemble Learning Based on Korean

  2021cites this paper
• A novel approach to tool condition monitoring based on multi-sensor data fusion imaging and an attention mechanism

  2021cites this paper
• Pre-Training Time-Aware Location Embeddings from Spatial-Temporal Trajectories

  2021cites this paper
• Knowledge Extraction: Automatic Classification of Matching Rules

  2021cites this paper
• Similarity-based approach for inventive design solutions assistance

  2021cites this paper
• G2Basy: A framework to improve the RNN language model and ease overfitting problem

  2021cites this paper
• Improving Skip-Gram Embeddings Using BERT

  2021cites this paper
• When does text prediction benefit from additional context? An exploration of contextual signals for chat and email messages

  2021cites this paper
• Back to Square One: Superhuman Performance in Chutes and Ladders Through Deep Neural Networks and Tree Search

  2021cites this paper
• Network Embedding Attack: An Euclidean Distance Based Method

  2021cites this paper
• Recurrent convolutional neural network for session-based recommendation

  2021cites this paper
• A Comparative Study of Korean Feature Granularity Based on Hybrid Neural Network

  2021cites this paper
• BiGRU-Multi-Head Self-Attention Network for Chinese sentiment classification

  2021cites this paper
• A combined syntactic-semantic embedding model based on lexicalized tree-adjoining grammar

  2021cites this paper
• Hierarchical Lovász Embeddings for Proposal-free Panoptic Segmentation

  2021cites this paper
• Pitfalls of Assessing Extracted Hierarchies for Multi-Class Classification

  2021cites this paper