Results for “Inference”

Journal articles (OpenAlex) Jun Hu, Li Qijian · Remote Sensing

Wavelet-Constrained Prior-Guided Flow Matching for Remote Sensing Spatiotemporal Fusion

Spatiotemporal fusion techniques can generate remote sensing imagery with both high spatial and temporal resolutions, thereby supporting a wide range of Earth observation applications. Although recent diffusion-based STF methods have shown promising reconstruction performance, generation from Gaussian noise typically requires many iterative sampling steps, resulting in considerable inference cost. To enable efficient few-step reconstruction, we propose WPFM-STF, a…

Read at Journal articles (OpenAlex)

AWS Machine Learning Blog Shantanu Tripathi SI

SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi-Instance GPU (MIG), which divides one GPU into hardware-isolated partitions so you can run a different model in each or take a right-sized fraction of a newer accelerator. This post shows how two optional API fields place one model per partition, and what we measured against a whole older GPU.

Read at AWS Machine Learning Blog

arXiv (research papers) Ahmed Zeer

Atik: A Shared-Mesh Transformer Accelerator for RISC-V

Transformer inference repeatedly invokes dense matrix multiplication and attention, including its data-dependent softmax normalization. We present Atik, an open-source RoCC accelerator for RocketChip that executes matrix multiplication and dense attention through one shared fixed-point MAC mesh. Atik accepts and returns BF16 tensors, uses a streaming online-softmax schedule that never materializes the full score matrix, and is invoked through a small descriptor-based ABI. We…

Read at arXiv (research papers)

Crunchbase News Guest Author Startups

How To Challenge A Monopoly In The AI Age

AI chip startups can challenge the sector's Goliath's by building substantially better hardware for emerging inference demands, much as Juniper challenged Cisco with a new architecture suited to the internet’s rapid growth. To win…

Read at Crunchbase News

EPIC Lauren Fischer Tech policy

WGAL: Data brokers sell your personal information with little regulation

“‘So, a data broker is a company that processes, aggregates and analyzes data to create inferences about us,’ said Sara Geoghegan of the Electronic Privacy Information Center in Washington.” “Geoghegan explained that the data broker industry, valued at an estimated $200 billion, is largely unregulated. ‘This is the Wild West and it’s really harmful. There … Continued

Read at EPIC

The New Stack Amanda Caswell

Together AI let coding agents rewrite its GPU code. Then it kept humans on the deploy button.

Together AI is putting AI coding agents to work on the GPU code that runs its inference infrastructure, automating performance

Read at The New Stack

Journal articles (OpenAlex) Qiang Han, Josh Dafoe, Bo Chen · Sensors

Enabling Large Model Inference in Dynamic and Heterogeneous Mobile Robots by Incorporating Collaborative Inference and Model Context Protocol

Modern robotic systems increasingly rely on transformer-based AI models to process sensor input and support high-level decision making. However, due to limited GPU resources in each ego robot, it is difficult to run a large model locally. Outsourcing the model inference to cloud providers could address this issue, which however suffers from limitations including unreliable network connection, high latency, and high monetary cost. In this work, we have developed an effective…

Read at Journal articles (OpenAlex)

Journal articles (OpenAlex) Jungwoo Lee, Jong-Deuk Lee, Young‐Ho Choi et al. · Robotics

Training-Free Inference-Budget Reduction in Flow-Matching Vision–Language–Action Models for Robot Manipulation: An Evaluation Against a Prespecified Task-Success Margin

Flow-matching vision–language–action (VLA) models generate robot actions through iterative denoising, making inference latency a deployment constraint. The acceleration methods reviewed here rarely assess task-success retention against a margin fixed before evaluation. We study three weight-preserving runtime levers on SmolVLA and π0.5: denoising-step count, masked camera prefix elimination, and execution horizon. In simulated closed-loop LIBERO evaluations, three…

Read at Journal articles (OpenAlex)

Journal articles (OpenAlex) Rizky Rahmatullah, Hidetaka Nambo · Sensors and Materials

Internet of Things-based ESP32 Mamdani Fuzzy Rainfall-risk Alert System with MATLAB Validation and Multichannel Alert Evaluation

Rainfall-related risks can disrupt agricultural activities, while conventional threshold-based warning systems may produce abrupt decisions near predefined boundaries and inadequately represent uncertainty among weather variables.In this study, we developed an Internet of Things (IoT)-based rainfall-risk alert system using a Mamdani fuzzy inference system implemented on a low-cost ESP32 platform.Hourly rainfall, relative humidity, and hourly atmospheric pressure change were…

Read at Journal articles (OpenAlex)

SiliconANGLE AI Duncan Riley SI

Generative media inference startup fal raises $1.3B at a $16B valuation

Generative media inference startup fal today announced it has raised $1.3 billion in new funding at a valuation of $16 billion, according to Bloomberg. The company will spend the money on computing power and on hiring beyond its current 185 employees. Fal provides a cloud platform for running image, video and audio generation models, and developers

Read at SiliconANGLE AI

TechCrunch Marina Temkin SI

AI inference startup Fal doubles its valuation to $16B as demand surges

The five-year-old startup raised a $1.3 billion round led by Bessemer.

Read at TechCrunch

Analytics India Magazine Kileuna Haralu SI

E2E Networks Launches Blaze To Offer Pay-Per-Token AI Inference Services

The platform provides a single API to access open AI models, including NVIDIA Nemotron, Sarvam, DeepSeek and Qwen, through NVIDIA GPU infrastructure hosted in I

Read at Analytics India Magazine

Journal articles (OpenAlex) Jangmook Kang, Seongwon BAE, Jongbin Park et al. · Electronics

Cyber-Resilient Mapless Navigation for Autonomous Mobile Robots: Cloud-Independent Edge Inference with Distilled Vision–Language Semantic Embeddings and LiDAR Fusion

Autonomous mobile robots (AMRs) that depend on remote inference introduce communication and service availability into the navigation control path. This paper presents a cloud-independent mapless-navigation architecture integrating visual features distilled offline from a vision–language model, PointNet++ light detection and ranging (LiDAR) features, and a Twin Delayed Deep Deterministic Policy Gradient (TD3) controller. An 8-bit integer (INT8)-quantized Vision Transformer…

Read at Journal articles (OpenAlex)

Journal articles (OpenAlex) Kadonsi Kaziya, Nelson Lungu · Frontiers in Education Tech policy

Teacher competence and institutional governance for learner data privacy in AI mediated education

Teachers can recognise a privacy problem yet lack the authority or resources needed to act on that judgement. Conversely, institutions can provide technically safeguarded services while teachers disclose unnecessary information or accept unsupported inferences. This Hypothesis and Theory article develops the Learner Data Protection Competence and Governance Framework to explain these two failures. A purposive conceptual synthesis connects contextual integrity with…

Read at Journal articles (OpenAlex)

Journal articles (OpenAlex) Xiaokai Zhou, Hao Huang, Quanqing Xu et al. · Data Science and Engineering Tech policy

VFCI: A Federated Framework for Vertical Causal Inference

Causal inference is crucial for understanding the relationship between cause and effect and is widely applied in fields such as medicine and policy decision-making. When the input data is distributed over multiple participants, most causal inference models require data to be centrally aggregated. However, participants are often prohibited or reluctant to share sensitive data due to data protection regulations and privacy concerns. To address this, federated learning has been…

Read at Journal articles (OpenAlex)

Tech in Asia Naomi Li Gan Startups

US AI inference startup Baseten targets $30b valuation

Founded in 2019, Baseten has been featured in Nvidia case studies on cloud-scale AI inference.

Read at Tech in Asia

Journal articles (OpenAlex) Bongjin Jung, Joongho Chang · Sensors Tech policy

Metamorphic Evidence as a Runtime Reliability Signal for Small Language Models

Small language models can run locally when resource, cost or data-protection constraints rule out a larger model that could check their answers. We consider a quantized model whose runtime exposes tokens and log-probabilities but not hidden states. We propose MOME (Module of Metamorphic Evidence), a runtime gate that estimates the risk of a wrong answer without ground-truth labels at inference time. MOME edits each problem twice, once keeping the correct answer and once…

Read at Journal articles (OpenAlex)

Journal articles (OpenAlex) Tahdia Tahmid, Sharfan Upaul · Water Policy

Water footprint of large AI models: risks to global water security and sustainable optimization strategies

ABSTRACT Diagram linking AI model training and inference to lifecycle water use, estimated at 4.2–6.6 billion m³ annually by 2027, and showing water reuse, efficient cooling, smarter workloads, and standardized reporting as strategies to protect global water security. The rapid proliferation of large-scale artificial intelligence (AI) models has introduced a significant yet underexamined environmental challenge: freshwater consumption. This narrative review synthesizes…

Read at Journal articles (OpenAlex)

SiliconANGLE AI Ryan Stevens SI

The race to deploy AI agents finds a familiar hurdle in data access

Enterprises racing to put AI agents into production are discovering that role-based access control, not model choice, decides whether those agents can be trusted. Rising inference costs, privacy worries and sovereignty demands are also pulling more AI workloads back inside corporate data centers. That shift favors companies that have spent years governing sensitive data at

Read at SiliconANGLE AI

arXiv (research papers) Doohyun Kim SI

SEAL: Sealed Queries for Local Sanitization against Indirect Prompt Injection

Indirect prompt injection threatens local LLM agents through untrusted tool outputs, motivating defenses that suppress attacks while preserving task evidence under limited inference budgets. We introduce SEAL, which learns a soft prompt and scoring readout offline to sanitize tool outputs using a frozen task model. SEAL constructs scoring queries from trusted initial context and the learned prompt, keeping the reference independent of inspected tool text. It scores tokens…

Read at arXiv (research papers)

SiliconANGLE AI Maria Deutscher SI

Oracle brings Google’s TPUs to its cloud, adds ChatGPT integrations

Oracle Corp. today announced plans to make Google LLC’s TPU artificial intelligence accelerators available through its public cloud. The initiative marks the first time the search giant is supplying the chips to another hyperscaler. According to CNBC, Oracle will also add Cerebras Systems Inc.’s wafer-scale accelerators and OpenAI Group PBC’s Jalapeño inference processor. The latter

Read at SiliconANGLE AI

TechCrunch Fundraising Tim Fernholz Startups

General Compute raises $100 million Series A, countering the neocloud disaster narrative

General Compute is betting on inference chips from outside the Nvidia ecosystem.

Read at TechCrunch Fundraising

Inc42 Palak Sharma Startups

Simplismart Bags $14 Mn To Expand AI Inference Platform

AI infrastructure startup Simplismart has raised $14 Mn (around ₹133 Cr) in a Series B funding round led by Dallas…

Read at Inc42

ServeTheHome Ryan Smith SI

ASRock Creator Radeon AI Pro R9700 Review: Workstation Inference, AMD Style

Today we are taking a look at ASRock's high-end Radeon AI inference card for workstations, the Creator Radeon AI Pro R9700. With 32GB of RAM and a $1700 price tag, the card is a highly affordable way to fill out a workstation for local AI inference

Read at ServeTheHome

SiliconANGLE AI Jonathan Anthony SI

Hybrid infrastructure decisions put AI costs and control in focus

Enterprise artificial intelligence is entering a cost-conscious phase, and hybrid infrastructure is where that reckoning plays out. As inference spending climbs, business leaders are weighing where models run, which models they use and how much of their data they are willing to hand to someone else. Those cost considerations are reshaping buying decisions across industries,

Read at SiliconANGLE AI

Journal articles (OpenAlex) Venkat Rao Pasupuleti, Karaka Tejasri, Vishni Teja et al. · Engineering Research Express

Physics-informed Graph-ResNet for real-time VLSI wirelength prediction with HPC enabled data

Abstract In very large scale integration physical design, accurate pre-routing wirelength prediction is a crucial bottleneck. Graph neural networks (GNNs) attain excellent accuracy but have seconds of inference latency, which prevents real-time application inside placement loops, whereas analytical heuristics diverge under congestion. To address these limitations, this paper presents a complete framework based on a proposed Physics-Informed Graph-ResNet. First, we create a…

Read at Journal articles (OpenAlex)

Semiconductor Digest Pete Singer SI

The Five Factors Defining the Next Generation of AI Inference Chips

As AI moves from model development to widespread deployment, the definition of a good AI chip is changing. Inference runs continuously across millions of devices under tight limits on latency, power, cost, memory and privacy, writes Ankur Saxena of TDK Ventures, and raw compute output is no longer the main benchmark.

Read at Semiconductor Digest

MIT Technology Review Tim Rausch SI

AI’s hidden storage bill: What inference leaves behind

Ask most executives to picture the cost of AI and they’ll likely see GPUs—racks of accelerators with gigawatts of power—and a waitlist for silicon. But that picture leaves something out: Data storage costs. What happens to data after a model responds? Much of the back-end data that’s generated—from billions of daily prompts, images, and videos—needs…

Read at MIT Technology Review

Older stories