You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 03:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Thu Mar 12, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40969279914070,1402cyclictest41527912sleep307:50:013
40969279911383,1130cyclictest73565-21sleep09:15:003
41453142270,1sleep30-21swapper/307:40:513
173198220,1rtkit-daemon0-21swapper/107:59:091
4096927992017,1cyclictest0-21swapper/311:20:003
4096927991912,3cyclictest112127-21sleep09:40:013
1730962190,1sleep00-21swapper/010:17:360
1279552180,1sleep10-21swapper/109:50:121
40959172171,11sleep24095954-21ntpq07:05:212
2813112172,5sleep0281345-21apt-get11:30:110
409692799169,4cyclictest3657382chrt12:25:123
4096927991613,1cyclictest0-21swapper/311:35:243
409692799161,11cyclictest332723-21taskset12:00:193
409692799156,6cyclictest4120740-21chrt07:25:173
409692799156,6cyclictest1431362sleep309:59:533
409692799151,9cyclictest41325472sleep307:35:113
4096927991512,1cyclictest0-21swapper/312:30:433
4096927991512,1cyclictest0-21swapper/309:45:123
4096927991512,1cyclictest0-21swapper/309:15:423
4096927991512,1cyclictest0-21swapper/308:22:123
4096927991512,1cyclictest0-21swapper/307:10:113
409692799151,11cyclictest281270-21taskset11:30:013
409692799151,10cyclictest228437-21taskset10:55:153
173198150,3rtkit-daemon4103700-21munin-node12:00:211
409692799145,6cyclictest143201-21sleep10:04:553
409692799141,9cyclictest31436-21taskset08:40:213
409692799141,9cyclictest311814-21taskset11:50:013
4096927991412,1cyclictest0-21swapper/310:20:373
4096927991412,0cyclictest0-21swapper/308:57:573
409692799141,11cyclictest281054-21sleep11:30:003
4096927991411,1cyclictest0-21swapper/312:36:343
4096927991411,1cyclictest0-21swapper/312:15:113
4096927991411,1cyclictest0-21swapper/311:20:123
4096927991411,1cyclictest0-21swapper/310:30:203
4096927991411,1cyclictest0-21swapper/310:10:253
4096927991411,1cyclictest0-21swapper/310:05:493
4096927991411,1cyclictest0-21swapper/309:42:413
4096927991411,1cyclictest0-21swapper/308:34:013
409692799141,10cyclictest84793-21taskset09:20:163
409692799141,10cyclictest58367-21taskset09:00:203
409692799141,10cyclictest4159484-21taskset07:55:023
409692799141,10cyclictest4118587-21taskset07:20:243
409692799141,10cyclictest4105943-21taskset07:15:103
409692799141,10cyclictest349851-21turbostat12:15:003
409692799141,10cyclictest341447-21chrt12:07:203
409692799141,10cyclictest242769-21taskset11:05:003
409692799141,10cyclictest242769-21taskset11:04:593
409692799141,10cyclictest211433-21chrt10:41:443
409692799141,10cyclictest173759-21turbostat10:20:003
409692799140,11cyclictest249691-21taskset11:07:133
2732212141,6sleep2273225-21ssh11:24:282
409692799135,6cyclictest25346-21taskset08:36:293
409692799135,6cyclictest25346-21taskset08:36:293
409692799134,6cyclictest41865982sleep308:15:143
409692799131,9cyclictest4173095-21taskset08:05:033
409692799131,9cyclictest4131215-21taskset07:30:183
409692799131,9cyclictest319531-21taskset11:55:093
409692799131,9cyclictest319276-21turbostat11:55:013
409692799131,9cyclictest224345-21taskset10:50:183
409692799131,9cyclictest187905-21taskset10:25:333
409692799131,9cyclictest102894-21taskset09:30:223
4096927991311,1cyclictest0-21swapper/310:45:123
409692799131,10cyclictest364751-21taskset12:22:313
409692799131,10cyclictest134721-21taskset09:52:593
4096927991311,0cyclictest0-21swapper/311:10:043
4096927991310,1cyclictest0-21swapper/311:40:113
4096927991310,1cyclictest0-21swapper/308:45:233
4096927991310,1cyclictest0-21swapper/308:25:163
409692799130,9cyclictest4179970-21taskset08:10:113
409692799130,11cyclictest4172871-21turbostat08:05:003
583132121,4sleep258366-21ntp_states09:00:212
409692799129,1cyclictest0-21swapper/310:35:113
409692799121,9cyclictest59872-21taskset09:05:143
409692799121,9cyclictest4152047-21taskset07:46:523
4096927991212,0cyclictest0-21swapper/309:27:333
2273162121,8sleep2227320-21ssh10:54:222
173198120,2rtkit-daemon171rcu_preempt10:33:040
873392111,7sleep287395-21ntpq09:20:202
41512462111,7sleep14151342-21ntpq07:45:181
409692799111,8cyclictest45360-21chrt08:52:113
3873252111,7sleep0387330-21sshd12:36:200
3192472111,6sleep1319381-21ls11:55:011
2135672110,7sleep2214690-21cut10:45:172
173198110,3rtkit-daemon326466-21ssh11:58:312
716232101,4sleep071684-21ntpq09:10:210
41272912100,7sleep04128715-21cut07:30:160
325492102,4sleep132582-21apt-get08:45:131
3118952101,5sleep0311930-21apt-get11:50:110
2600742101,6sleep0262046-21kthreadcore11:15:160
2423302101,6sleep065891-21diskmemload11:03:260
2423302101,6sleep065891-21diskmemload11:03:260
173198100,7rtkit-daemon4103700-21munin-node08:59:071
173198100,6rtkit-daemon95845-21sh09:26:211
173198100,6rtkit-daemon257290-21ssh11:11:552
173198100,6rtkit-daemon134670-21ssh09:52:472
173198100,5rtkit-daemon4167994-21grep08:00:161
173198100,5rtkit-daemon302017-21memory11:40:180
173198100,4rtkit-daemon500-21gmain08:10:571
173198100,3rtkit-daemon72450-21ssh09:11:011
173198100,3rtkit-daemon4103700-21munin-node12:32:050
1258002101,5sleep1125852-21ntpq09:45:201
1110892100,3sleep0111093-21ssh09:36:130
81060290,7sleep281062-21ssh09:18:272
4179527291,5sleep24179578-21grep08:10:002
4152804291,4sleep04152837-21apt-get07:50:110
4118327291,5sleep24118586-21/usr/sbin/munin07:20:242
4105908291,4sleep24105940-21apt-get07:15:112
40969279998,0cyclictest0-21swapper/307:10:013
326854291,5sleep0326920-21munin-run12:00:010
219074290,1sleep10-21swapper/110:46:441
17319890,6rtkit-daemon435-21avahi-daemon08:54:101
17319890,5rtkit-daemon65891-21diskmemload12:01:492
17319890,5rtkit-daemon65891-21diskmemload11:22:070
17319890,5rtkit-daemon1-21systemd09:05:221
17319890,1rtkit-daemon0-21swapper/212:20:002
161341294,2sleep1163456-21cut10:10:171
97094281,3sleep297129-21apt-get09:30:102
53710281,5sleep154218-21kthreadcore09:00:161
4139256280,5sleep14139269-21acpi07:40:101
4090475281,3sleep04090508-21apt-get07:05:100
378831281,3sleep2378888-21ntp_offset12:30:212
341382281,5sleep1341383-21sh12:07:071
340376281,1sleep00-21swapper/012:05:220
334813280,4sleep2334850-21apt-get12:05:122
32292281,4sleep032308-21munin-run08:45:000
294490280,5sleep0294537-21ntpq11:35:200
273658280,5sleep1273694-21apt11:25:111
265667280,5sleep1265671-21ssh11:19:541
257657281,4sleep1643-21snmpd11:13:171
257104281,5sleep065891-21diskmemload11:11:160
249444280,5sleep165891-21diskmemload11:06:201
241024281,4sleep2241079-21ntp_states11:00:202
241024281,4sleep2241079-21ntp_states11:00:202
236363283,2sleep1237537-21kthreadcore11:00:141
236363283,2sleep1237537-21kthreadcore11:00:141
201076280,4sleep1202343-21memory10:35:181
182634280,6sleep1183822-21kthreadcore10:25:161
174670280,5sleep2175662-21grep10:20:162
17319880,5rtkit-daemon500-21gmain09:16:451
17319880,5rtkit-daemon435-21avahi-daemon07:55:402
17319880,4rtkit-daemon88709-21ssh09:23:201
17319880,4rtkit-daemon65891-21diskmemload11:51:522
17319880,4rtkit-daemon65891-21diskmemload10:28:370
17319880,4rtkit-daemon643-21snmpd07:42:012
17319880,4rtkit-daemon453-21wpa_supplicant08:44:421
17319880,4rtkit-daemon435-21avahi-daemon07:11:162
17319880,4rtkit-daemon421-21rpcbind12:26:070
17319880,4rtkit-daemon421-21rpcbind10:06:032
17319880,4rtkit-daemon4132301-21munin-run07:34:592
17319880,4rtkit-daemon4119294-21apt-get07:25:122
17319880,4rtkit-daemon343673-21irqrtprio12:10:142
17319880,4rtkit-daemon275630-21cut11:25:170
17319880,4rtkit-daemon0-21swapper/207:52:152
17319880,3rtkit-daemon4132740-21diskstats07:35:132
17319880,3rtkit-daemon287926-21ssh11:32:062
17319880,3rtkit-daemon229788-21kthreadcore10:55:150
166405280,4sleep2166444-21ssh10:15:112
158797281,4sleep0158944-21df10:10:120
135821281,4sleep2135823-21ssh09:55:112
96245270,5sleep296249-21ssh09:27:502
80247271,2sleep00-21swapper/009:15:300
4518270,4sleep24654-21netstat08:20:182
4187791270,5sleep24189138-21kthreadcore08:15:172
4184986271,3sleep00-21swapper/008:10:180
4160387270,5sleep04161321-21cat07:55:160
4103549270,4sleep14104779-21grep07:15:021
4102558270,4sleep04102607-21ntpq07:10:200
4091852271,3sleep14093320-21kthreadcore07:05:161
39177270,4sleep20-21swapper/208:50:112
371128270,4sleep2371217-21ssh12:25:202
351596270,4sleep0352737-21cut12:15:160
348784270,4sleep1348786-21ssh12:11:001
319540270,4sleep1319575-21ssh11:55:131
311442270,4sleep065891-21diskmemload11:49:230
309802270,4sleep2309856-21ntpq11:45:202
296654270,4sleep2296689-21apt-get11:40:112
291419270,5sleep1293434-21cut11:35:171
248564270,4sleep2248613-21ntpq11:05:202
202543271,3sleep0202603-21ntpq10:35:210
191053270,4sleep1193013-21cut10:30:171
174246270,4sleep0174371-21hddtemp_smartct10:20:140
17319870,4rtkit-daemon500-21gmain12:15:482
17319870,4rtkit-daemon500-21gmain11:45:241
17319870,4rtkit-daemon500-21gmain10:48:040
17319870,4rtkit-daemon453-21wpa_supplicant10:11:352
17319870,4rtkit-daemon4103700-21munin-node12:22:070
17319870,4rtkit-daemon4103700-21munin-node11:28:512
17319870,4rtkit-daemon4103700-21munin-node10:52:370
17319870,4rtkit-daemon4103700-21munin-node08:07:071
17319870,4rtkit-daemon135771-21packagekitd10:00:072
17319870,3rtkit-daemon65891-21diskmemload11:44:571
17319870,3rtkit-daemon649-21ntpd08:25:161
17319870,3rtkit-daemon647-21lldpd07:45:152
17319870,3rtkit-daemon643-21snmpd08:20:501
17319870,3rtkit-daemon4103700-21munin-node09:37:481
17319870,3rtkit-daemon295096-21ssh11:35:252
17319870,3rtkit-daemon208038-21kthreadcore10:40:150
17319870,3rtkit-daemon119280-21ssh09:43:211
17319870,1rtkit-daemon0-21swapper/108:37:541
17319870,1rtkit-daemon0-21swapper/108:37:531
172934270,1sleep1172936-21ssh10:16:581
158430270,4sleep065891-21diskmemload10:09:520
14593271,3sleep10-21swapper/108:30:151
141448271,3sleep1141485-21ntpq09:55:221
127947271,3sleep0127950-21apt-get09:50:120
72868260,2sleep20-21swapper/209:12:312
6786260,3sleep07809-21kthreadcore08:25:170
65571260,1sleep20-21swapper/209:05:582
52431260,1sleep00-21swapper/008:58:430
4181160261,3sleep24181192-21kthreadcore08:10:162
4172534260,1sleep00-21swapper/008:00:560
4166753261,2sleep20-21swapper/208:00:152
4138978260,1sleep00-21swapper/007:39:570
4119260260,3sleep14119290-21awk07:25:121
4111422260,3sleep04111466-21ntpq07:15:210
4099861261,2sleep10-21swapper/107:10:171
388084260,3sleep2388088-21ssh12:39:102
386534260,3sleep1386585-21ssh12:35:211
373321261,2sleep10-21swapper/112:30:121
358070261,2sleep10-21swapper/112:20:101
356821260,1sleep1356825-21ssh12:16:251
342405260,3sleep065891-21diskmemload12:10:030
282738260,3sleep1284509-21cut11:30:161
27928260,3sleep230015-21cut08:40:172
264847260,1sleep20-21swapper/211:16:502
234285260,3sleep1234289-21ssh10:56:501
228109260,3sleep2228434-21cut10:55:152
221150261,2sleep10-21swapper/110:50:171
21037260,3sleep222323-21kthreadcore08:35:172
21037260,3sleep222323-21kthreadcore08:35:172
206445260,3sleep2208392-21grep10:40:162
204923261,2sleep10-21swapper/110:40:101
196965260,3sleep2197000-21ssh10:35:112
196404261,3sleep2196408-21ssh10:33:542
18985261,2sleep20-21swapper/208:35:012
17319860,3rtkit-daemon649-21ntpd09:30:041
17319860,3rtkit-daemon643-21snmpd08:15:361
158088260,3sleep165891-21diskmemload10:08:371
150070260,4sleep1150073-21sh10:02:151
126758260,3sleep0126762-21ssh09:46:420
118784260,1sleep20-21swapper/209:41:322
118552260,1sleep00-21swapper/009:40:420
104720261,2sleep20-21swapper/209:35:112
103763261,2sleep072-21kcompactd009:32:290
95108251,2sleep00-21swapper/009:25:230
88374250,1sleep00-21swapper/009:22:030
65830250,3sleep00-21swapper/009:09:200
52807250,2sleep052840-21apt-get09:00:110
46094250,2sleep20-21swapper/208:55:122
45326250,3sleep00-21swapper/008:51:440
4193085250,1sleep00-21swapper/008:20:040
4192811250,1sleep00-21swapper/008:19:560
4173102250,1sleep00-21swapper/008:05:100
4154180250,2sleep10-21swapper/107:50:161
4145500250,1sleep00-21swapper/007:43:180
4138092250,2sleep10-21swapper/107:35:211
4125905250,1sleep10-21swapper/107:30:051
4125418250,1sleep00-21swapper/007:26:550
4118969250,1sleep00-21swapper/007:24:350
37984250,2sleep20-21swapper/208:45:222
366011250,2sleep10-21swapper/112:25:141
334235251,2sleep04096922-21cyclictest12:03:580
25383250,1sleep00-21swapper/008:36:590
25383250,1sleep00-21swapper/008:36:590
250420250,3sleep00-21swapper/011:09:590
183826250,3sleep2185823-21grep10:25:162
181011250,3sleep10-21swapper/110:23:311
150065250,1sleep00-21swapper/010:02:140
137667251,2sleep00-21swapper/009:55:170
13469250,2sleep00-21swapper/008:30:140
12019250,1sleep20-21swapper/208:26:182
4152064240,3sleep00-21swapper/007:47:060
4112945240,2sleep10-21swapper/107:20:151
37383240,2sleep037927-21grep08:45:200
272922240,2sleep1272926-21ssh11:23:231
122119240,1sleep20-21swapper/209:45:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional