Excellent AI, Deep Learning
Limited-Time GPU Server Sale!
Powerful AI Servers, Supporting Diverse Models and Platforms!
AI Hosting Sales for Nvidia GPU Server
Enjoy up to 44% off on high-performance GPU hosting servers! Develop and deploy your models with GPU Mart’s on-demand Nvidia GPUs, starting at just $0.04 per hour.
- GPU Server Price:
- Parameters:
- GPU Memory:
- GPU Card Model:
Lite GPU Dedicated Server - K620
$ 49.00/mo
1mo3mo12mo24mo
Order Now- 16GB RAM
- Quad-Core Xeon E3-1270v3
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro K620
- Microarchitecture: Maxwell
- CUDA Cores: 384
- GPU Memory: 2GB DDR3
- FP32 Performance: 0.863 TFLOPS
- Ideal for lightweight Android emulators, small LLMs, graphic processing, and more. Powerful than GPU VPS.
Express GPU Dedicated Server - P600
$ 52.00/mo
1mo3mo12mo24mo
Order Now- 32GB RAM
- Quad-Core Xeon E5-2643
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro P600
- Microarchitecture: Pascal
- CUDA Cores: 384
- GPU Memory: 2GB GDDR5
- FP32 Performance: 1.2 TFLOPS
Flash sale to June 16
Express GPU Dedicated Server - P620
$ 34.50/mo
50% OFF Recurring (Was $69.00)
1mo3mo12mo24mo
Order Now- 32GB RAM
- Eight-Core Xeon E5-2670
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro P620
- Microarchitecture: Pascal
- CUDA Cores: 512
- GPU Memory: 2GB GDDR5
- FP32 Performance: 1.5 TFLOPS
Express GPU Dedicated Server - P1000
$ 64.00/mo
1mo3mo12mo24mo
Order Now- 32GB RAM
- Eight-Core Xeon E5-2690
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro P1000
- Microarchitecture: Pascal
- CUDA Cores: 640
- GPU Memory: 4GB GDDR5
- FP32 Performance: 1.894 TFLOPS
Half-Year Pay, Full-Year Deal
Basic GPU Dedicated Server - GTX 1650
$ 59.50/mo
50% OFF Recurring (Was $119.00)
1mo3mo12mo24mo
Order Now- 64GB RAM
- Eight-Core Xeon E5-2667v3
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia GeForce GTX 1650
- Microarchitecture: Turing
- CUDA Cores: 896
- GPU Memory: 4GB GDDR5
- FP32 Performance: 3.0 TFLOPS
Basic GPU Dedicated Server - T1000
$ 99.00/mo
1mo3mo12mo24mo
Order Now- 64GB RAM
- Eight-Core Xeon E5-2690
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro T1000
- Microarchitecture: Turing
- CUDA Cores: 896
- GPU Memory: 8GB GDDR6
- FP32 Performance: 2.5 TFLOPS
- Ideal for Light Gaming, Remote Design, Android Emulators, and Entry-Level AI Tasks, etc
Flash Sale to June 16
Professional GPU VPS - A4000
$ 99.00/mo
44% OFF Recurring (Was $179.00)
1mo3mo12mo24mo
Order Now- 32GB RAM
- 24 CPU Cores
- 320GB SSD
- 300Mbps Unmetered Bandwidth
- Once per 2 Weeks Backup
- OS: Linux / Windows 10/ Windows 11
- Dedicated GPU: Quadro RTX A4000
- CUDA Cores: 6,144
- Tensor Cores: 192
- GPU Memory: 16GB GDDR6
- FP32 Performance: 19.2 TFLOPS
- Available for Rendering, AI/Deep Learning, Data Science, CAD/CGI/DCC.
Flash sale to June 16
Basic GPU Dedicated Server - GTX 1660
$ 86.00/mo
45% OFF Recurring (Was $159.00)
1mo3mo12mo24mo
Order Now- 64GB RAM
- Dual 10-Core Xeon E5-2660v2
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia GeForce GTX 1660
- Microarchitecture: Turing
- CUDA Cores: 1408
- GPU Memory: 6GB GDDR6
- FP32 Performance: 5.0 TFLOPS
Half-Year Pay, Full-Year Deal
Basic GPU Dedicated Server - RTX 4060
$ 89.50/mo
50% OFF Recurring (Was $179.00)
1mo3mo12mo24mo
Order Now- 64GB RAM
- Eight-Core E5-2690
- 120GB SSD + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia GeForce RTX 4060
- Microarchitecture: Ada Lovelace
- CUDA Cores: 3072
- Tensor Cores: 96
- GPU Memory: 8GB GDDR6
- FP32 Performance: 15.11 TFLOPS
New Arrival
Basic GPU Dedicated Server - RTX 5060
$ 159.00/mo
1mo3mo12mo24mo
Order Now- 64GB RAM
- 24-Core Platinum 8160
- 120GB SSD + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia GeForce RTX 5060
- Microarchitecture: Blackwell 2.0
- CUDA Cores: 4608
- Tensor Cores: 144
- GPU Memory: 8GB GDDR7
- FP32 Performance: 23.22 TFLOPS
Professional GPU Dedicated Server - RTX 2060
$ 199.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 10-Core E5-2660v2
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia GeForce RTX 2060
- Microarchitecture: Ampere
- CUDA Cores: 1920
- Tensor Cores: 240
- GPU Memory: 6GB GDDR6
- FP32 Performance: 6.5 TFLOPS
- Powerful for Gaming, OBS Streaming, Video Editing, Android Emulators, 3D Rendering, etc
Professional GPU Dedicated Server - P100
$ 169.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 10-Core E5-2660v2
- 120GB + 960GB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Tesla P100
- Microarchitecture: Pascal
- CUDA Cores: 3584
- GPU Memory: 16 GB HBM2
- FP32 Performance: 9.5 TFLOPS
- Suitable for AI, Data Modeling, High Performance Computing, etc.
Advanced GPU Dedicated Server - RTX 3060 Ti
$ 239.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 12-Core E5-2697v2
- 240GB SSD + 2TB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: GeForce RTX 3060 Ti
- Microarchitecture: Ampere
- CUDA Cores: 4864
- Tensor Cores: 152
- GPU Memory: 8GB GDDR6
- FP32 Performance: 16.2 TFLOPS
Advanced GPU Dedicated Server - A4000
$ 279.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 12-Core E5-2697v2
- 240GB SSD + 2TB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro RTX A4000
- Microarchitecture: Ampere
- CUDA Cores: 6144
- Tensor Cores: 192
- GPU Memory: 16GB GDDR6
- FP32 Performance: 19.2 TFLOPS
Advanced GPU Dedicated Server - V100
$ 229.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 12-Core E5-2690v3
- 240GB SSD + 2TB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia V100
- Microarchitecture: Volta
- CUDA Cores: 5,120
- Tensor Cores: 640
- GPU Memory: 16GB HBM2
- FP32 Performance: 14 TFLOPS
- Cost-effective for AI, deep learning, data visualization, HPC, etc
Multi-GPU Dedicated Server - 2xRTX 4060
$ 269.00/mo
1mo3mo12mo24mo
Order Now- 64GB RAM
- Eight-Core E5-2690
- 120GB SSD + 960GB SSD
- 1Gbps
- OS: Windows / Linux
- GPU: 2 x Nvidia GeForce RTX 4060
- Microarchitecture: Ada Lovelace
- CUDA Cores: 3072
- Tensor Cores: 96
- GPU Memory: 8GB GDDR6
- FP32 Performance: 15.11 TFLOPS
Half-Year Pay, Full-Year Deal
Advanced GPU Dedicated Server - A5000
$ 191.90/mo
45% OFF Recurring (Was $349.00)
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 12-Core E5-2697v2
- 240GB SSD + 2TB SSD
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro RTX A5000
- Microarchitecture: Ampere
- CUDA Cores: 8192
- Tensor Cores: 256
- GPU Memory: 24GB GDDR6
- FP32 Performance: 27.8 TFLOPS
Multi-GPU Dedicated Server - 2xRTX 3060 Ti
$ 319.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 12-Core E5-2697v2
- 240GB SSD + 2TB SSD
- 1Gbps
- OS: Windows / Linux
- GPU: 2 x GeForce RTX 3060 Ti
- Microarchitecture: Ampere
- CUDA Cores: 4864
- Tensor Cores: 152
- GPU Memory: 8GB GDDR6
- FP32 Performance: 16.2 TFLOPS
Multi-GPU Dedicated Server - 2xRTX A4000
$ 359.00/mo
1mo3mo12mo24mo
Order Now- 128GB RAM
- Dual 12-Core E5-2697v2
- 240GB SSD + 2TB SSD
- 1Gbps
- OS: Windows / Linux
- GPU: 2 x Nvidia RTX A4000
- Microarchitecture: Ampere
- CUDA Cores: 6144
- Tensor Cores: 192
- GPU Memory: 16GB GDDR6
- FP32 Performance: 19.2 TFLOPS
Flash sale to June 16
Multi-GPU Dedicated Server - 3xRTX 3060 Ti
$ 274.00/mo
45% OFF Recurring (Was $499.00)
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 3 x GeForce RTX 3060 Ti
- Microarchitecture: Ampere
- CUDA Cores: 4864
- Tensor Cores: 152
- GPU Memory: 8GB GDDR6
- FP32 Performance: 16.2 TFLOPS
Enterprise GPU Dedicated Server - RTX 4090
$ 409.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: GeForce RTX 4090
- Microarchitecture: Ada Lovelace
- CUDA Cores: 16,384
- Tensor Cores: 512
- GPU Memory: 24 GB GDDR6X
- FP32 Performance: 82.6 TFLOPS
Enterprise GPU Dedicated Server - RTX A6000
$ 409.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia Quadro RTX A6000
- Microarchitecture: Ampere
- CUDA Cores: 10,752
- Tensor Cores: 336
- GPU Memory: 48GB GDDR6
- FP32 Performance: 38.71 TFLOPS
Enterprise GPU Dedicated Server - A40
$ 439.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia A40
- Microarchitecture: Ampere
- CUDA Cores: 10,752
- Tensor Cores: 336
- GPU Memory: 48GB GDDR6
- FP32 Performance: 37.48 TFLOPS
- Ideal for hosting AI image generator, deep learning, HPC, 3D Rendering, VR/AR etc.
New Arrival
Enterprise GPU Dedicated Server - RTX 5090
$ 479.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: GeForce RTX 5090
- Microarchitecture: Ada Lovelace
- CUDA Cores: 20,480
- Tensor Cores: 680
- GPU Memory: 32 GB GDDR7
- FP32 Performance: 109.7 TFLOPS
Flash sale to June 16
Multi-GPU Dedicated Server - 3xV100
$ 304.85/mo
49% OFF Recurring (Was $599.00)
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 3 x Nvidia V100
- Microarchitecture: Volta
- CUDA Cores: 5,120
- Tensor Cores: 640
- GPU Memory: 16GB HBM2
- FP32 Performance: 14 TFLOPS
- Expertise in deep learning and AI workloads with more tensor cores
Multi-GPU Dedicated Server - 3xV100
$ 469.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 3 x Nvidia V100
- Microarchitecture: Volta
- CUDA Cores: 5,120
- Tensor Cores: 640
- GPU Memory: 16GB HBM2
- FP32 Performance: 14 TFLOPS
- Expertise in deep learning and AI workloads with more tensor cores
Multi-GPU Dedicated Server - 3xRTX A5000
$ 539.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 3 x Quadro RTX A5000
- Microarchitecture: Ampere
- CUDA Cores: 8192
- Tensor Cores: 256
- GPU Memory: 24GB GDDR6
- FP32 Performance: 27.8 TFLOPS
Enterprise GPU Dedicated Server - A100
$ 639.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia A100
- Microarchitecture: Ampere
- CUDA Cores: 6912
- Tensor Cores: 432
- GPU Memory: 40GB HBM2
- FP32 Performance: 19.5 TFLOPS
- Good alternativeto A800, H100, H800, L40. Support FP64 precision computation, large-scale inference/AI training/ML.etc
Multi-GPU Dedicated Server- 2xRTX 4090
$ 729.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 2 x GeForce RTX 4090
- Microarchitecture: Ada Lovelace
- CUDA Cores: 16,384
- Tensor Cores: 512
- GPU Memory: 24 GB GDDR6X
- FP32 Performance: 82.6 TFLOPS
Multi-GPU Dedicated Server - 3xRTX A6000
$ 899.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 3 x Quadro RTX A6000
- Microarchitecture: Ampere
- CUDA Cores: 10,752
- Tensor Cores: 336
- GPU Memory: 48GB GDDR6
- FP32 Performance: 38.71 TFLOPS
New Arrival
Multi-GPU Dedicated Server- 2xRTX 5090
$ 859.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual Gold 6148
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 2 x GeForce RTX 5090
- Microarchitecture: Ada Lovelace
- CUDA Cores: 20,480
- Tensor Cores: 680
- GPU Memory: 32 GB GDDR7
- FP32 Performance: 109.7 TFLOPS
Multi-GPU Dedicated Server - 2xA100
$ 1099.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: Nvidia A100
- Microarchitecture: Ampere
- CUDA Cores: 6912
- Tensor Cores: 432
- GPU Memory: 40GB HBM2
- FP32 Performance: 19.5 TFLOPS
- Free NVLink Included
- A Powerful Dual-GPU Solution for Demanding AI Workloads, Large-Scale Inference, ML Training.etc. A cost-effective alternative to A100 80GB and H100, delivering exceptional performance at a competitive price.
Multi-GPU Dedicated Server - 4xRTX A6000
$ 1199.00/mo
1mo3mo12mo24mo
Order Now- 512GB RAM
- Dual 22-Core E5-2699v4
- 240GB SSD + 4TB NVMe + 16TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 4 x Quadro RTX A6000
- Microarchitecture: Ampere
- CUDA Cores: 10,752
- Tensor Cores: 336
- GPU Memory: 48GB GDDR6
- FP32 Performance: 38.71 TFLOPS
New Arrival
Enterprise GPU Dedicated Server - A100(80GB)
$ 1559.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia A100
- Microarchitecture: Ampere
- CUDA Cores: 6912
- Tensor Cores: 432
- GPU Memory: 80GB HBM2e
- FP32 Performance: 19.5 TFLOPS
Multi-GPU Dedicated Server - 8xV100
$ 1499.00/mo
1mo3mo12mo24mo
- 512GB RAM
- Dual 22-Core E5-2699v4
- 240GB SSD + 4TB NVMe + 16TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 8 x Nvidia Tesla V100
- Microarchitecture: Volta
- CUDA Cores: 5,120
- Tensor Cores: 640
- GPU Memory: 16GB HBM2
- FP32 Performance: 14 TFLOPS
Multi-GPU Dedicated Server - 4xA100
$ 1899.00/mo
1mo3mo12mo24mo
Order Now- 512GB RAM
- Dual 22-Core E5-2699v4
- 240GB SSD + 4TB NVMe + 16TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 4 x Nvidia A100
- Microarchitecture: Ampere
- CUDA Cores: 6912
- Tensor Cores: 432
- GPU Memory: 40GB HBM2
- FP32 Performance: 19.5 TFLOPS
Enterprise GPU Dedicated Server - H100
$ 2099.00/mo
1mo3mo12mo24mo
Order Now- 256GB RAM
- Dual 18-Core E5-2697v4
- 240GB SSD + 2TB NVMe + 8TB SATA
- 100Mbps-1Gbps
- OS: Windows / Linux
- GPU: Nvidia H100
- Microarchitecture: Hopper
- CUDA Cores: 14,592
- Tensor Cores: 456
- GPU Memory: 80GB HBM2e
- FP32 Performance: 183TFLOPS
Multi-GPU Dedicated Server - 8xRTX A6000
$ 2099.00/mo
1mo3mo12mo24mo
Order Now- 512GB RAM
- Dual 22-Core E5-2699v4
- 240GB SSD + 4TB NVMe + 16TB SATA
- 1Gbps
- OS: Windows / Linux
- GPU: 8 x Quadro RTX A6000
- Microarchitecture: Ampere
- CUDA Cores: 10,752
- Tensor Cores: 336
- GPU Memory: 48GB GDDR6
- FP32 Performance: 38.71 TFLOPS
Recommended Resources for Optimizing Your AI Hosting Server
To help you get the most out of your AI hosting server, we've curated a list of valuable resources and benchmarks. These guides and performance tests will assist you in choosing the right GPU and optimizing your setup for popular LLMs like Ollama
Choosing the Right GPU for Your AI Workloads
Learn how to select the best GPU for your specific AI tasks and models click here to view a more details.
GPU Benchmarks for Ollama
These benchmarks provide insights into how different GPUs perform with Ollama across various model sizes, helping you choose the ideal hardware for your AI hosting server
Ollama GPU Benchmark: P1000 click here to view a more detailed.
Ollama GPU Benchmark: T1000click here to view a more detailed.
Ollama GPU Benchmark: GTX 1660click here to view a more detailed.
Ollama GPU Benchmark: RTX 4060click here to view a more detailed.
Ollama GPU Benchmark: RTX 2060click here to view a more detailed.
Ollama GPU Benchmark: RTX 3060 Ticlick here to view a more detailed.
Ollama GPU Benchmark: A4000click here to view a more detailed.
Ollama GPU Benchmark: V100click here to view a more detailed.
Ollama GPU Benchmark: A5000click here to view a more detailed.
Ollama GPU Benchmark: RTX 4090click here to view a more detailed.
Ollama GPU Benchmark: A40click here to view a more detailed.
Ollama GPU Benchmark: A6000click here to view a more detailed.
Ollama GPU Benchmark: A100 40GBclick here to view a more detailed.
Ollama GPU Benchmark: Dual A100click here to view a more detailed.
Ollama GPU Benchmark: H100click here to view a more detailed.
What Clients Say about our AI hosting GPU Server?
Delivering exceptional service and support is our highest priority at GPU Mart. Here’s a glimpse of what our clients have said about their experience with our GPU server services.
We’ve been using their GPU servers to run 70B models, and the performance is incredible. The 48GB GPUs handle everything seamlessly, and the setup process was a breeze. Highly recommend for anyone working with large AI models!
We evaluated multiple GPU server providers, and they offer the best value for money. Compared to other vendors, we achieved better performance at a lower cost here. It's especially suitable for teams with limited budgets but high computing power demands.
We needed a reliable server for our 14B models, and their 16GB GPU plan was exactly what we needed. The flexibility to choose our preferred inference engine made deployment so easy. Great service!
We started with a single GPU and upgraded to a multi-GPU setup as our needs grew. The scalability is fantastic, and the pricing is very competitive. Perfect for growing AI teams!
We tested their servers with a free trial, and the performance was so impressive that we signed up immediately. Being able to benchmark our models before committing was a huge plus. Highly recommend!
We needed a server that could handle our unique environment, and they delivered. The ability to customize the setup and choose our own tools made all the difference.
We use the RTX 4090 server for AI-generated artwork, style transfer, and automated image editing, and its performance has exceeded our expectations. Compared to consumer-grade GPUs, this server offers superior stability and computing power, making it ideal for professional AI image processing tasks.
Questions About AI Hosting Promotion
Find answers to your most common questions in our FAQ section. For personalized recommendations or further assistance, don't hesitate to reach out to our online support team.
1. What is an AI hosting server, and how does it work?
GPU Mart's provide GPU-powered physical servers (bare metal) with dedicated IP access. You can remotely log in, choose your preferred LLM inference engine, and deploy your AI models effortlessly.
2. Which platforms are supported?
There are no platform restrictions. However, different platforms may quantize models differently, which can affect the final model size and performance.
3. What GPU memory is required for a 14B model?
We recommend a 16GB GPU for running 14B models efficiently.
4. What GPU memory is required for a 32B model?
For 32B models, we recommend a GPU with 24GB or more memory.
5. What GPU memory is required for a 70B model?
To run 70B models smoothly, we recommend a GPU with 48GB or more memory.
6. When should I choose a multi-GPU plan?
A multi-GPU plan is ideal when a single GPU cannot handle higher concurrency or larger model sizes. If your workload demands more power, consider upgrading to a multi-GPU setup.
7. Can I upgrade my server configuration later?
Yes! You can upgrade GPU memory and storage space. Some servers also support adding additional GPUs. Contact us for custom upgrade options.
8. Can I run benchmarks on my own models before committing?
Yes, we offer free trials for select products. Reach out to us to request a free trial and test your models.
9. Is server maintenance included, or am I responsible for it?
We handle all server maintenance, so you can focus on running your AI tasks without worrying about hardware management.
10. Can I customize the server environment to fit my needs?
Absolutely! You have full control to configure the server environment according to your requirements.
11. Can I use your servers for both inference and training tasks?
Our servers are optimized for inference and reasoning tasks. For training, please contact us to discuss your specific needs.
12. How many GPU servers can I buy with the AI hosting promotion?
Limited for 3 GPU dedicated server plans. If you require bulk purchasing, please contact our sales team for a unique discount arrangement.
13. What's the minimum duration for a GPU server order?
You can order AI hosting GPU server for any duration of one month or longer.
14. What's the meaning of recurring discount?
'Recurring discount' means your discount will still be available when you renew a AI hosting/machine learning server.
15. Can I get a discount for my existing GPU server?
Unfortunately, AI hosting promotions are only available for new GPU server orders. However, you can contact our sales team to inquire about special renewal discounts.
16. Will the discount remain if I upgrade/downgrade the plan after the promotion?
No, the discount will not be valid if the target plan is excluded from the AI hosting GPU server promotion.
17. What payment methods do you accept?
We accept Visa, MasterCard, American Express, JCB, Discover, Diners Club, PayPal, Wire Transfer, and Check. Note that non-instant payment methods will delay service deployment until the payment clears. Wire Transfers must be over $100. Paper checks are only for U.S. clients.
18. How long will it take to set up my server?
Typically, GPU dedicated server setup takes 20-40 minutes. Customized GPU server will take longer.
19. Can I get a free trial before payment?
We offer a 24-hour free trial for new clients who wish to test our GPU server. To request a trial server, please follow these steps:
Step 1: Submit a Free Trial Request
Select a plan, click 'Order Now,' and leave a note saying 'Need free trial.' Then, click 'Check Out' and proceed to the Order Confirm page. On this page, you must click 'Confirm' to complete the free trial request.
Step 2: Security Verification
This process takes about 30 minutes to 2 hours. Once verified, you will receive the server login details in the console and can start using it.If your trial request is not approved, you will be notified via email.
Custom Servers
Can't find your ideal server? Send us your custom requirements, and our sales rep will provide a tailored solution for you.
Server Inquiry
Confused about choosing a server or have questions? Consult online support for recommendations.