midnightcoderagent commited on
Commit
7029e38
Β·
verified Β·
1 Parent(s): a20c4cc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +238 -11
README.md CHANGED
@@ -1,16 +1,243 @@
1
  ---
2
  license: apache-2.0
 
 
 
3
  language:
4
- - en
5
- base_model:
6
- - Qwen/Qwen3-Coder-30B-A3B-Instruct
7
  tags:
8
- - gguf
9
- - qwen3
10
- - coding
11
- - software-engineering
12
- - agent
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  - llama.cpp
14
- - ollama
15
- - developer-tools
16
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
4
+ library_name: llama.cpp
5
+ pipeline_tag: text-generation
6
  language:
7
+ - en
 
 
8
  tags:
9
+ - gguf
10
+ - qwen3
11
+ - coding
12
+ - code-assistant
13
+ - software-engineering
14
+ - agent
15
+ - llama.cpp
16
+ - ollama
17
+ - local-ai
18
+ - developer-tools
19
+ ---
20
+
21
+ # πŸŒ™ MidnightCoder-30B-GGUF
22
+
23
+ > **A GGUF distribution of Qwen3-Coder-30B-A3B-Instruct optimized for the Midnight Coder software engineering agent.**
24
+
25
+ MidnightCoder-30B-GGUF is designed for developers who want to run a powerful coding model locally using **llama.cpp**, **Ollama**, **LM Studio**, or any GGUF-compatible inference engine.
26
+
27
+ This distribution is intended to work together with the **Midnight Coder** agent, providing a structured and specification-driven software engineering workflow.
28
+
29
+ ---
30
+
31
+ # Features
32
+
33
+ - πŸš€ Optimized for software engineering
34
+ - πŸ“ Specification-driven development
35
+ - πŸ€– Designed for AI coding agents
36
+ - πŸ”§ Compatible with llama.cpp
37
+ - πŸ¦™ Compatible with Ollama
38
+ - πŸ’» Local-first development
39
+ - πŸ“š Strong support for large codebases
40
+ - πŸ” Refactoring and debugging assistance
41
+ - πŸ§ͺ Test generation support
42
+ - πŸ“– Documentation generation
43
+
44
+ ---
45
+
46
+ # Base Model
47
+
48
+ This model is based on:
49
+
50
+ **Qwen3-Coder-30B-A3B-Instruct**
51
+
52
+ All credit for the pretrained model belongs to the **Qwen Team (Alibaba)**.
53
+
54
+ This repository distributes the model in **GGUF** format for local inference.
55
+
56
+ ---
57
+
58
+ # About Midnight Coder
59
+
60
+ Midnight Coder is an open-source AI coding assistant focused on structured software engineering.
61
+
62
+ Instead of behaving like a generic chatbot, Midnight Coder follows an engineering workflow centered around planning, specifications, implementation, and verification.
63
+
64
+ Typical workflow:
65
+
66
+ 1. Understand the task
67
+ 2. Create a technical specification
68
+ 3. Define implementation scope
69
+ 4. Implement changes
70
+ 5. Verify results
71
+ 6. Report completed work
72
+
73
+ This workflow helps produce predictable, maintainable, and review-friendly code.
74
+
75
+ ---
76
+
77
+ # Intended Use
78
+
79
+ MidnightCoder-30B-GGUF is suitable for:
80
+
81
+ - Software Engineering
82
+ - Backend Development
83
+ - Frontend Development
84
+ - API Design
85
+ - SQL
86
+ - Docker
87
+ - DevOps
88
+ - Linux
89
+ - Code Review
90
+ - Refactoring
91
+ - Documentation
92
+ - Debugging
93
+ - Architecture Discussions
94
+
95
+ ---
96
+
97
+ # Compatible Software
98
+
99
+ The model can be used with:
100
+
101
  - llama.cpp
102
+ - Ollama
103
+ - LM Studio
104
+ - Open WebUI
105
+ - Jan
106
+ - KoboldCpp
107
+ - Text Generation WebUI
108
+ - Any GGUF-compatible runtime
109
+
110
+ ---
111
+
112
+ # Recommended Context
113
+
114
+ Recommended context sizes:
115
+
116
+ | Context | Recommended Usage |
117
+ |----------|-------------------|
118
+ | 8K | Small projects |
119
+ | 16K | General development |
120
+ | 32K | Large repositories |
121
+ | 64K+ | Complex multi-file projects (hardware permitting) |
122
+
123
+ ---
124
+
125
+ # Quantization
126
+
127
+ This repository provides the model in GGUF format.
128
+
129
+ The quantization is indicated in the filename.
130
+
131
+ Examples:
132
+
133
+ - Q4_K_M
134
+ - Q5_K_M
135
+ - Q6_K
136
+ - Q8_0
137
+
138
+ ---
139
+
140
+ # Example (llama.cpp)
141
+
142
+ ```bash
143
+ llama-cli \
144
+ -m MidnightCoder-30B-Q4_K_M.gguf \
145
+ -c 32768
146
+ ```
147
+
148
+ ---
149
+
150
+ # Example (Ollama)
151
+
152
+ Create a Modelfile:
153
+
154
+ ```text
155
+ FROM MidnightCoder-30B-Q4_K_M.gguf
156
+
157
+ SYSTEM """
158
+ <Midnight Coder system prompt>
159
+ """
160
+ ```
161
+
162
+ Build:
163
+
164
+ ```bash
165
+ ollama create midnightcoder -f Modelfile
166
+ ```
167
+
168
+ Run:
169
+
170
+ ```bash
171
+ ollama run midnightcoder
172
+ ```
173
+
174
+ ---
175
+
176
+ # Performance Notes
177
+
178
+ The required memory depends on:
179
+
180
+ - Quantization
181
+ - Context size
182
+ - KV cache precision
183
+ - Runtime configuration
184
+
185
+ Lower quantizations reduce memory usage while higher quantizations generally preserve more model quality.
186
+
187
+ ---
188
+
189
+ # Limitations
190
+
191
+ Like any language model:
192
+
193
+ - Responses may contain inaccuracies.
194
+ - Generated code should always be reviewed.
195
+ - Security-sensitive code requires human validation.
196
+ - Production deployments should include proper testing.
197
+
198
+ ---
199
+
200
+ # License
201
+
202
+ This repository distributes a GGUF version of the original model.
203
+
204
+ Please refer to the original **Qwen3-Coder-30B-A3B-Instruct** license for licensing terms regarding the base model.
205
+
206
+ ---
207
+
208
+ # Acknowledgements
209
+
210
+ Special thanks to:
211
+
212
+ - Alibaba Qwen Team
213
+ - Hugging Face
214
+ - llama.cpp
215
+ - Ollama
216
+
217
+ for making local AI development accessible to the community.
218
+
219
+ ---
220
+
221
+ # Midnight Coder
222
+
223
+ Midnight Coder is an open-source project dedicated to building high-quality AI tools for software developers.
224
+
225
+ ## Links
226
+
227
+ **GitHub**
228
+
229
+ https://github.com/midnightcoderagent/Midnight-Coder
230
+
231
+ **Organization**
232
+
233
+ https://huggingface.co/MidnightCoder
234
+
235
+ ---
236
+
237
+ ## Disclaimer
238
+
239
+ This repository is an independent GGUF distribution based on **Qwen3-Coder-30B-A3B-Instruct**.
240
+
241
+ It is **not an official release** from the Qwen Team or Alibaba.
242
+
243
+ All trademarks and original model rights belong to their respective owners.