You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 22:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Apr 14, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991050,5rtkit-daemon2484-21rtkit-daemon08:15:310
3043621040,4sleep3361ktimersoftd/307:45:353
15047997421,45cyclictest7787-21diskmemload07:50:160
15047997420,46cyclictest3170-21unixbench_multi08:40:330
15047997324,27cyclictest13379-21grep06:15:390
15047997317,48cyclictest0-21swapper/008:49:540
15047997222,42cyclictest15762-21grep09:00:180
15047997222,42cyclictest15762-21grep09:00:180
248599710,6rtkit-daemon0-21swapper/005:15:230
15047997120,32cyclictest32756-21taskset08:37:360
15047997119,31cyclictest0-21swapper/007:59:530
15047997115,39cyclictest7787-21diskmemload07:25:200
15047997114,43cyclictest0-21swapper/009:19:490
15047997113,50cyclictest0-21swapper/007:30:190
15047997024,39cyclictest26406-21tail07:40:230
15047997018,45cyclictest0-21swapper/010:40:090
15047997017,36cyclictest0-21swapper/010:20:120
15047997017,36cyclictest0-21swapper/010:20:120
241772692,59sleep20-21swapper/209:12:502
171902690,4chrt17189-21sh07:26:442
15047996920,42cyclictest9144-21switchtime10:25:280
15047996920,31cyclictest27838-21sed08:30:200
15047996916,46cyclictest0-21swapper/009:10:120
15047996915,47cyclictest0-21swapper/008:00:310
15047996819,42cyclictest0-21swapper/007:20:470
15047996817,44cyclictest0-21swapper/009:48:470
15047996815,21cyclictest0-21swapper/007:17:130
1505299674,26cyclictest0-21swapper/207:52:012
15047996720,39cyclictest1419-21runrttasks06:35:050
15047996718,31cyclictest1243-21lldpd08:59:540
15047996716,35cyclictest0-21swapper/009:58:120
15047996711,36cyclictest0-21swapper/008:05:180
15047996620,39cyclictest0-21swapper/009:35:280
15047996620,38cyclictest22853-21tune2fs07:35:200
15047996620,38cyclictest22853-21tune2fs07:35:200
15047996617,43cyclictest0-21swapper/009:20:260
15047996616,43cyclictest0-21swapper/008:25:090
15047996616,43cyclictest0-21swapper/007:49:480
15047996616,32cyclictest0-21swapper/010:33:300
204362654,13sleep20-21swapper/209:06:292
197982654,12sleep20-21swapper/210:41:142
15047996518,27cyclictest4280-21kworker/0:010:35:320
15047996516,42cyclictest0-21swapper/009:25:130
15047996516,41cyclictest0-21swapper/006:55:170
15047996516,41cyclictest0-21swapper/006:55:170
15047996514,35cyclictest0-21swapper/006:10:110
15047996514,35cyclictest0-21swapper/006:10:110
15047996512,45cyclictest0-21swapper/010:15:210
15047996512,32cyclictest0-21swapper/009:33:130
15047996419,37cyclictest0-21swapper/010:05:190
15047996418,40cyclictest0-21swapper/010:00:100
15047996418,30cyclictest1683-21nscd07:05:030
15047996416,41cyclictest0-21swapper/008:25:000
280992632,9sleep10-21swapper/107:43:121
15053996333,12cyclictest0-21swapper/309:35:183
15047996319,30cyclictest0-21swapper/008:10:300
15047996317,30cyclictest0-21swapper/010:11:570
15047996317,28cyclictest8744-21munin-node08:50:150
15047996315,41cyclictest20134-21ssh09:05:330
33992613,50sleep23447-21diskstats09:30:152
15047996120,34cyclictest26003-21kworker/0:207:15:030
15047996115,30cyclictest0-21swapper/005:45:240
15047996115,29cyclictest0-21swapper/006:00:210
15047996114,30cyclictest0-21swapper/006:20:210
15047996112,33cyclictest0-21swapper/009:50:570
15047996112,33cyclictest0-21swapper/009:40:170
15047996112,33cyclictest0-21swapper/009:40:170
1505299604,49cyclictest12414-21chrt08:07:152
1505299604,48cyclictest1571-21ssh10:15:132
1505099604,34cyclictest0-21swapper/109:43:371
1505099604,34cyclictest0-21swapper/109:43:371
15047996016,38cyclictest0-21swapper/006:50:030
135812603,50sleep10-21swapper/107:21:241
15053995922,21cyclictest0-21swapper/309:18:263
15047995915,37cyclictest7202-21cpuspeed_turbos06:05:200
15053995831,13cyclictest0-21swapper/309:13:583
15053995831,13cyclictest0-21swapper/307:42:203
15053995830,12cyclictest0-21swapper/309:48:553
1505299584,47cyclictest0-21swapper/208:30:312
1505299584,47cyclictest0-21swapper/206:50:212
1505299584,47cyclictest0-21swapper/206:50:212
15052995818,34cyclictest281ktimersoftd/210:30:172
15047995817,35cyclictest1287-21snmpd05:42:110
15047995817,34cyclictest3233-21munin-node07:05:250
15047995813,37cyclictest0-21swapper/006:40:220
15047995811,39cyclictest0-21swapper/005:24:120
15047995810,34cyclictest0-21swapper/005:53:460
276252570,4sleep2281ktimersoftd/207:41:272
15053995730,13cyclictest0-21swapper/308:30:343
1505399572,20cyclictest23923-21chrt07:35:393
1505399572,20cyclictest23923-21chrt07:35:393
1505299575,45cyclictest0-21swapper/210:35:282
1505299574,46cyclictest0-21swapper/208:41:342
1505299573,46cyclictest0-21swapper/208:00:162
1505299573,45cyclictest8414-21tr07:15:162
1505099575,35cyclictest0-21swapper/108:50:281
15050995719,22cyclictest0-21swapper/108:38:021
15047995729,21cyclictest0-21swapper/005:15:070
15047995714,30cyclictest0-21swapper/005:58:470
15047995714,28cyclictest0-21swapper/006:35:310
15047995713,37cyclictest0-21swapper/006:25:180
15053995628,12cyclictest0-21swapper/305:30:203
1505299564,45cyclictest7787-21diskmemload08:10:182
1505299564,45cyclictest11464-21munin-node07:20:322
1505299564,45cyclictest0-21swapper/209:35:082
1505299564,45cyclictest0-21swapper/207:45:212
1505299563,46cyclictest0-21swapper/210:05:252
15050995628,10cyclictest24250-21missed_timers10:00:211
15047995615,34cyclictest29914-21timerandwakeup06:50:350
15047995615,34cyclictest29914-21timerandwakeup06:50:350
248599550,5rtkit-daemon2484-21rtkit-daemon07:59:473
1505399554,44cyclictest0-21swapper/309:59:413
1505299554,44cyclictest0-21swapper/207:56:212
15052995525,12cyclictest0-21swapper/209:50:222
15047995514,35cyclictest0-21swapper/005:25:240
15047995514,35cyclictest0-21swapper/005:25:240
1505299544,44cyclictest0-21swapper/210:12:322
1505299544,44cyclictest0-21swapper/208:22:012
1505299544,43cyclictest23688-21fschecks_count10:00:132
1505299544,43cyclictest0-21swapper/210:20:302
1505299544,43cyclictest0-21swapper/210:20:302
1505299544,43cyclictest0-21swapper/209:55:162
1505299544,43cyclictest0-21swapper/209:03:402
1505299544,43cyclictest0-21swapper/209:03:402
1505299544,43cyclictest0-21swapper/208:37:342
1505099545,26cyclictest0-21swapper/107:59:301
1505099544,29cyclictest0-21swapper/109:10:221
15050995424,12cyclictest0-21swapper/107:47:421
15050995414,33cyclictest12441-21sed08:55:181
282352532,42sleep10-21swapper/105:40:311
248599530,5rtkit-daemon2484-21rtkit-daemon08:40:223
248599530,5rtkit-daemon2484-21rtkit-daemon08:15:233
202762533,44sleep30-21swapper/309:05:583
15053995327,12cyclictest0-21swapper/308:10:463
1505299538,38cyclictest0-21swapper/209:47:242
1505299536,40cyclictest0-21swapper/208:55:122
1505299536,37cyclictest0-21swapper/205:30:242
1505299534,44cyclictest0-21swapper/207:34:362
1505299534,43cyclictest0-21swapper/209:20:032
1505099536,30cyclictest0-21swapper/108:15:201
15050995322,12cyclictest0-21swapper/109:05:261
15047995316,31cyclictest26988-21awk05:40:070
12242532,9sleep30-21swapper/307:50:323
34492523,8sleep33505-21grep09:30:163
315922522,9sleep30-21swapper/305:48:153
248599520,5rtkit-daemon2484-21rtkit-daemon09:20:063
248599520,5rtkit-daemon2484-21rtkit-daemon08:35:533
248599520,5rtkit-daemon2484-21rtkit-daemon08:21:463
1505399524,42cyclictest0-21swapper/307:30:253
15053995214,18cyclictest0-21swapper/307:24:523
1505299529,9cyclictest24603-21ssh07:38:012
1505299529,9cyclictest24603-21ssh07:38:012
1505299524,42cyclictest0-21swapper/209:15:382
1505299524,42cyclictest0-21swapper/208:50:152
15052995236,10cyclictest25133-21cpuspeed_turbos05:35:212
1505299523,43cyclictest0-21swapper/209:29:282
1505299523,43cyclictest0-21swapper/205:16:432
1505099527,22cyclictest0-21swapper/106:20:181
1505099525,29cyclictest0-21swapper/105:20:341
1505099524,31cyclictest0-21swapper/108:00:181
1505099524,27cyclictest0-21swapper/108:28:311
1505099524,26cyclictest0-21swapper/106:04:101
1505099523,26cyclictest25732-21crond06:45:031
67722512,9sleep10-21swapper/110:22:551
67722512,9sleep10-21swapper/110:22:551
61412513,41sleep36219-21processes08:45:303
44002512,9sleep20-21swapper/206:00:072
3412512,9sleep30-21swapper/310:14:383
248599510,5rtkit-daemon2484-21rtkit-daemon09:40:283
248599510,5rtkit-daemon2484-21rtkit-daemon09:40:283
248599510,5rtkit-daemon2484-21rtkit-daemon09:29:583
248599510,5rtkit-daemon2484-21rtkit-daemon09:04:143
248599510,5rtkit-daemon2484-21rtkit-daemon09:04:143
160782512,9sleep20-21swapper/206:23:452
15053995135,9cyclictest4087-21gltestperf07:05:223
15053995134,11cyclictest11527-21df_abs10:30:113
15053995126,12cyclictest0-21swapper/310:25:123
15053995110,33cyclictest0-21swapper/307:25:223
1505299514,41cyclictest18710-21taskset08:15:352
1505299514,41cyclictest0-21swapper/209:43:282
1505299514,41cyclictest0-21swapper/209:43:282
1505299513,41cyclictest0-21swapper/210:25:102
1505099515,28cyclictest0-21swapper/106:10:241
1505099515,28cyclictest0-21swapper/106:10:241
1505099515,27cyclictest0-21swapper/109:45:151
1505099515,27cyclictest0-21swapper/107:25:331
1505099515,26cyclictest0-21swapper/107:17:301
1505099515,13cyclictest0-21swapper/107:00:281
15050995122,10cyclictest26710-21ssh09:15:311
15050995120,13cyclictest0-21swapper/107:33:481
87162502,9sleep30-21swapper/306:06:133
248599500,4rtkit-daemon2484-21rtkit-daemon08:59:593
207032502,9sleep30-21swapper/306:31:483
200662502,9sleep10-21swapper/110:42:141
173962502,9sleep30-21swapper/305:19:503
15053995035,9cyclictest5283-21tail06:00:253
1505399503,24cyclictest0-21swapper/310:06:253
15053995028,10cyclictest0-21swapper/310:19:393
15053995021,24cyclictest0-21swapper/310:03:183
1505099505,28cyclictest0-21swapper/109:20:351
1505099505,28cyclictest0-21swapper/108:40:321
1505099505,27cyclictest0-21swapper/109:25:581
1505099505,26cyclictest0-21swapper/106:50:051
1505099504,29cyclictest0-21swapper/107:10:291
1505099504,28cyclictest0-21swapper/110:10:101
1505099504,28cyclictest0-21swapper/105:25:221
1505099504,28cyclictest0-21swapper/105:25:221
1505099504,27cyclictest0-21swapper/108:30:321
1505099504,13cyclictest0-21swapper/108:21:021
1505099504,11cyclictest11563-21kworker/1:108:10:341
1505099503,23cyclictest26818-21expr10:05:101
15050995022,12cyclictest0-21swapper/109:30:301
15050995021,12cyclictest0-21swapper/107:50:241
15050995021,12cyclictest0-21swapper/105:50:261
15050995020,13cyclictest0-21swapper/109:35:111
15050995020,12cyclictest0-21swapper/110:25:211
15050995019,13cyclictest0-21swapper/110:35:101
15047995026,17cyclictest0-21swapper/005:30:250
326842492,9sleep30-21swapper/306:57:243
326842492,9sleep30-21swapper/306:57:243
248599490,5rtkit-daemon2484-21rtkit-daemon08:05:163
248599490,5rtkit-daemon2484-21rtkit-daemon08:00:173
1505299496,13cyclictest0-21swapper/206:45:382
1505299495,25cyclictest0-21swapper/208:46:042
1505299494,27cyclictest0-21swapper/205:55:232
1505099497,24cyclictest0-21swapper/107:35:181
1505099497,24cyclictest0-21swapper/107:35:181
1505099496,27cyclictest0-21swapper/109:04:151
1505099496,27cyclictest0-21swapper/109:04:151
1505099494,27cyclictest0-21swapper/106:05:281
1505099494,27cyclictest0-21swapper/105:55:271
1505099494,27cyclictest0-21swapper/105:50:071
1505099494,27cyclictest0-21swapper/105:35:071
1505099493,29cyclictest0-21swapper/110:30:131
15050994928,8cyclictest4605-21processes07:05:311
100472492,9sleep10-21swapper/108:05:091
92442483,9sleep30-21swapper/306:10:123
92442483,9sleep30-21swapper/306:10:123
248212482,9sleep10-21swapper/105:35:151
1505399484,38cyclictest0-21swapper/309:50:473
1505399484,28cyclictest0-21swapper/307:15:243
1505399483,40cyclictest0-21swapper/310:20:093
1505399483,40cyclictest0-21swapper/310:20:093
15053994826,10cyclictest0-21swapper/307:10:343
1505299485,14cyclictest0-21swapper/207:10:252
1505299483,41cyclictest0-21swapper/205:45:302
1505299483,38cyclictest23351-21latency_hist06:40:052
15052994821,9cyclictest2513-21udisks-daemon08:25:272
1505099485,26cyclictest0-21swapper/106:35:051
1505099485,24cyclictest0-21swapper/109:56:211
1505099484,27cyclictest0-21swapper/106:55:151
1505099484,27cyclictest0-21swapper/106:55:151
1505099484,27cyclictest0-21swapper/106:50:321
1505099484,27cyclictest0-21swapper/106:50:321
1505099484,27cyclictest0-21swapper/106:35:401
1505099484,26cyclictest0-21swapper/109:50:211
15050994819,12cyclictest0-21swapper/110:16:441
15050994819,12cyclictest0-21swapper/108:48:031
140602484,6sleep10-21swapper/105:10:301
303812472,9sleep30-21swapper/306:53:333
303812472,9sleep30-21swapper/306:53:333
254612473,7sleep325465-21munin-node08:25:353
248599470,4rtkit-daemon2484-21rtkit-daemon05:14:232
19562472,9sleep30-21swapper/305:55:133
1505399473,38cyclictest0-21swapper/310:40:273
15053994727,15cyclictest0-21swapper/307:05:043
1505299474,28cyclictest0-21swapper/206:15:252
1505299474,28cyclictest0-21swapper/205:40:242
1505099473,32cyclictest0-21swapper/105:15:461
1505099473,24cyclictest12524-21gltestperf06:15:251
15050994718,12cyclictest0-21swapper/106:25:231
51212462,37sleep20-21swapper/207:06:292
241622463,7sleep324256-21grep06:40:233
1505399464,36cyclictest0-21swapper/308:52:203
15053994631,9cyclictest27531-21cut05:40:223
15053994630,10cyclictest21539-21tr06:35:203
1505399463,36cyclictest0-21swapper/306:30:053
15053994625,10cyclictest0-21swapper/305:24:233
1505399462,35cyclictest14584-21ssh10:35:103
15052994631,9cyclictest19373-21unixbench_multi05:20:372
15052994630,10cyclictest346-21tr05:50:252
15052994626,14cyclictest0-21swapper/206:40:222
15052994619,11cyclictest0-21swapper/206:31:022
323562452,36sleep30-21swapper/305:50:213
15053994530,9cyclictest22200-21crond05:30:073
15053994530,9cyclictest22200-21crond05:30:073
1505399453,33cyclictest0-21swapper/305:15:083
1505299454,35cyclictest0-21swapper/206:15:062
1505299454,35cyclictest0-21swapper/206:15:062
1505299454,27cyclictest0-21swapper/205:25:212
1505299454,27cyclictest0-21swapper/205:25:212
15052994530,10cyclictest1335-21grep07:00:222
1505299453,26cyclictest0-21swapper/206:28:512
267972442,9sleep30-21swapper/305:37:553
1505299444,35cyclictest0-21swapper/206:05:362
136932442,9sleep30-21swapper/306:18:553
161212432,9sleep30-21swapper/306:24:193
1505399434,12cyclictest0-21swapper/306:45:223
1505299434,26cyclictest0-21swapper/206:55:172
1505299434,26cyclictest0-21swapper/206:55:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional