You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 13:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 02, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31799992723,4cyclictest0-21swapper/223:40:102
3180199250,24cyclictest4859-21ssh00:30:053
31799992523,1cyclictest0-21swapper/200:01:592
31799992520,4cyclictest0-21swapper/223:26:182
31799992520,0cyclictest0-21swapper/223:18:192
3179999250,24cyclictest17422-21fschecks_count23:08:362
31794992523,1cyclictest2855-21ssh21:50:561
3179499250,24cyclictest30247-21memory00:23:381
3179499250,24cyclictest29846-21kworker/u8:222:22:361
31790992524,1cyclictest25415-21diskmemload22:00:500
3179099250,24cyclictest0-21swapper/000:18:300
31801992423,1cyclictest25415-21diskmemload22:49:593
31801992423,1cyclictest23356-21ssh22:10:213
31801992422,1cyclictest17813-21idleruntime-cro22:05:003
3180199240,23cyclictest25415-21diskmemload22:30:313
3180199240,23cyclictest25415-21diskmemload22:20:253
3180199240,23cyclictest0-21swapper/322:06:253
3179999242,21cyclictest3656-21sh21:20:182
31799992422,1cyclictest17648-21ssh22:04:472
31799992420,2cyclictest29211-21ssh22:16:292
3179999240,23cyclictest25415-21diskmemload22:30:462
3179999240,23cyclictest25415-21diskmemload21:15:012
3179999240,23cyclictest0-21swapper/221:41:222
3179999240,23cyclictest0-21swapper/200:35:352
3179999240,0cyclictest25415-21diskmemload00:11:122
31794992424,0cyclictest0-21swapper/123:30:401
3179499241,22cyclictest783-21snmpd21:41:041
3179499241,1cyclictest0-21swapper/100:40:001
3179499240,24cyclictest0-21swapper/122:56:131
3179499240,23cyclictest25415-21diskmemload23:57:341
3179499240,23cyclictest25415-21diskmemload23:46:451
3179499240,23cyclictest25415-21diskmemload23:35:101
3179499240,23cyclictest25415-21diskmemload22:10:191
3179499240,23cyclictest25415-21diskmemload21:24:381
3179499240,23cyclictest0-21swapper/123:14:111
3179499240,23cyclictest0-21swapper/122:00:171
3179499240,23cyclictest0-21swapper/121:38:201
3179499240,0cyclictest0-21swapper/123:08:491
31790992423,1cyclictest62550irq/127-eno100:30:150
31790992423,1cyclictest16442-21sh22:35:090
31790992422,1cyclictest4223-21ssh21:21:080
31790992422,1cyclictest0-21swapper/023:43:000
31790992421,2cyclictest0-21swapper/022:40:200
3179099240,23cyclictest25835-21cut22:13:350
3179099240,23cyclictest25415-21diskmemload21:59:520
3179099240,23cyclictest25415-21diskmemload21:16:100
3179099240,23cyclictest2331-21sh23:56:240
3179099240,23cyclictest14483-21ssh21:31:100
3179099240,23cyclictest14349-21ssh23:04:510
3179099240,23cyclictest14198-21ssh23:36:490
3179099240,23cyclictest10662-21sh22:29:280
3179099240,23cyclictest10662-21sh22:29:280
3179099240,1cyclictest593-21rm23:53:560
3179099240,1cyclictest0-21swapper/021:10:430
3179099240,0cyclictest0-21swapper/000:28:410
31801992323,0cyclictest0-21swapper/321:35:183
31801992323,0cyclictest0-21swapper/321:21:053
31801992321,1cyclictest1541-21apt-get20:23:323
31801992321,1cyclictest0-21swapper/323:25:413
31801992321,1cyclictest0-21swapper/322:28:173
31801992321,1cyclictest0-21swapper/322:28:173
31801992321,1cyclictest0-21swapper/319:45:003
31801992320,2cyclictest11312-21rm23:02:473
3180199230,2cyclictest13799-21sh23:36:153
3180199230,23cyclictest25415-21diskmemload00:07:153
3180199230,23cyclictest0-21swapper/323:55:103
3180199230,23cyclictest0-21swapper/323:08:183
3180199230,23cyclictest0-21swapper/321:33:163
3180199230,23cyclictest0-21swapper/300:37:243
3180199230,22cyclictest8995-21sh21:57:023
3180199230,22cyclictest31733-21ssh23:22:423
3180199230,22cyclictest28177-21sleep20:10:013
3180199230,22cyclictest25771-21rm23:16:213
3180199230,22cyclictest25415-21diskmemload21:30:003
3180199230,22cyclictest25415-21diskmemload00:00:123
3180199230,22cyclictest19929-21sh22:38:393
3180199230,22cyclictest0-21swapper/323:40:433
31799992323,0cyclictest25415-21diskmemload21:29:052
31799992323,0cyclictest0-21swapper/223:36:082
31799992323,0cyclictest0-21swapper/223:33:192
31799992323,0cyclictest0-21swapper/222:44:062
31799992323,0cyclictest0-21swapper/222:35:402
31799992323,0cyclictest0-21swapper/221:31:012
31799992323,0cyclictest0-21swapper/221:12:452
31799992321,1cyclictest0-21swapper/223:52:372
31799992321,1cyclictest0-21swapper/222:25:272
31799992321,1cyclictest0-21swapper/222:25:272
31799992320,2cyclictest27927-21ssh23:49:422
3179999230,2cyclictest21308-21grep22:08:382
3179999230,23cyclictest25415-21diskmemload00:20:342
3179999230,23cyclictest0-21swapper/223:24:002
3179999230,23cyclictest0-21swapper/222:51:092
3179999230,23cyclictest0-21swapper/221:48:552
3179999230,22cyclictest25415-21diskmemload23:55:262
3179999230,22cyclictest25415-21diskmemload21:36:532
3179999230,22cyclictest17202-21kworker/u8:100:15:142
3179999230,1cyclictest0-21swapper/200:25:282
3179999230,0cyclictest0-21swapper/222:55:492
3179999230,0cyclictest0-21swapper/222:20:352
3179999230,0cyclictest0-21swapper/200:34:002
3179999230,0cyclictest0-21swapper/200:06:482
31794992323,0cyclictest25415-21diskmemload23:25:391
31794992323,0cyclictest0-21swapper/123:43:001
31794992323,0cyclictest0-21swapper/122:42:321
31794992323,0cyclictest0-21swapper/121:25:551
31794992323,0cyclictest0-21swapper/100:32:171
31794992322,1cyclictest29608-21ssh21:45:401
31794992322,1cyclictest25415-21diskmemload00:02:061
31794992321,1cyclictest9489-21apt-get19:33:311
31794992321,1cyclictest0-21swapper/123:23:011
31794992321,1cyclictest0-21swapper/122:45:481
31794992320,2cyclictest4595-21awk00:30:001
3179499230,23cyclictest0-21swapper/122:33:151
3179499230,23cyclictest0-21swapper/122:29:421
3179499230,23cyclictest0-21swapper/122:29:421
3179499230,23cyclictest0-21swapper/122:06:401
3179499230,23cyclictest0-21swapper/121:30:181
3179499230,22cyclictest13186-21ssh00:07:161
3179499230,0cyclictest25415-21diskmemload00:11:061
3179499230,0cyclictest0-21swapper/123:00:441
3179499230,0cyclictest0-21swapper/121:15:041
3179499230,0cyclictest0-21swapper/121:11:501
31790992323,0cyclictest0-21swapper/023:30:400
31790992323,0cyclictest0-21swapper/023:27:010
31790992323,0cyclictest0-21swapper/023:20:450
31790992323,0cyclictest0-21swapper/022:49:000
31790992323,0cyclictest0-21swapper/000:38:240
31790992322,1cyclictest0-21swapper/022:52:050
31790992321,1cyclictest29158-21ssh23:19:070
31790992321,1cyclictest0-21swapper/000:22:210
3179099230,2cyclictest30312-21ssh21:46:520
3179099230,23cyclictest0-21swapper/022:15:360
3179099230,23cyclictest0-21swapper/000:11:060
3179099230,22cyclictest6330-21ssh21:53:460
3179099230,22cyclictest24326-21taskset21:40:370
3179099230,1cyclictest19022-21sh22:06:350
3179099230,1cyclictest11404-21ssh00:04:440
3179099230,0cyclictest0-21swapper/023:14:110
31801992222,0cyclictest0-21swapper/323:50:523
31801992222,0cyclictest0-21swapper/300:11:053
31801992221,1cyclictest26062-21ssh21:10:483
31801992220,1cyclictest24313-21ssh21:40:353
31801992220,1cyclictest20941-21cron19:55:003
31801992220,1cyclictest0-21swapper/323:45:563
31801992220,1cyclictest0-21swapper/321:18:143
3180199220,22cyclictest0-21swapper/322:41:353
3180199220,21cyclictest4803-21sh22:55:323
3180199220,21cyclictest29830-21sh21:46:093
3180199220,21cyclictest0-21swapper/323:31:203
3180199220,21cyclictest0-21swapper/323:10:053
3180199220,21cyclictest0-21swapper/319:38:323
3180199220,1cyclictest3401-21apt-get20:25:023
3180199220,1cyclictest29190-21sh00:23:233
3180199220,1cyclictest25415-21diskmemload00:15:243
3180199220,1cyclictest0-21swapper/322:15:303
3180199220,1cyclictest0-21swapper/321:53:113
3180199220,0cyclictest25415-21diskmemload22:52:193
3180199220,0cyclictest0-21swapper/300:28:033
31799992222,0cyclictest0-21swapper/222:46:112
31799992221,1cyclictest0-21swapper/221:55:242
31799992217,4cyclictest0-21swapper/222:11:152
3179999220,21cyclictest25415-21diskmemload23:00:032
3179999220,21cyclictest0-21swapper/223:10:162
3179999220,1cyclictest4695-21apt-get19:23:312
31794992222,0cyclictest0-21swapper/123:17:271
31794992222,0cyclictest0-21swapper/122:37:431
31794992222,0cyclictest0-21swapper/120:43:311
31794992221,1cyclictest0-21swapper/122:50:441
31794992220,1cyclictest22987-21cron21:05:011
31794992220,1cyclictest18215-21perf20:55:011
3179499220,22cyclictest0-21swapper/122:16:011
3179499220,21cyclictest28164-21perf20:10:011
3179499220,21cyclictest22482-21ssh00:15:521
3179499220,21cyclictest21490-21apt-get19:58:331
3179499220,21cyclictest20950-21dump-pmu-power19:55:001
3179499220,21cyclictest0-21swapper/119:23:311
3179499220,1cyclictest0-21swapper/123:50:081
31790992221,1cyclictest19385-21diskmemload21:35:480
31790992221,1cyclictest0-21swapper/022:31:380
31790992220,1cyclictest20977-21awk19:55:000
31790992219,2cyclictest15314-21sh23:05:540
3179099220,21cyclictest9040-21ssh21:25:420
3179099220,21cyclictest25415-21diskmemload23:46:250
3179099220,1cyclictest8219-21threads22:58:420
3179099220,1cyclictest11920-21ssh00:05:070
3179099220,0cyclictest0-21swapper/022:20:210
3180199210,0cyclictest11543-21apt-get20:43:313
3180199210,0cyclictest0-21swapper/319:13:313
31799992120,0cyclictest0-21swapper/220:03:302
31799992119,1cyclictest23353-21cron20:00:012
3179999210,20cyclictest23543-21apt-get21:08:342
3179999210,20cyclictest13940-21apt-get20:48:332
3179999210,20cyclictest0-21swapper/220:13:322
3179999210,0cyclictest25415-21diskmemload21:50:392
31794992120,1cyclictest0-21swapper/120:58:321
31790992121,0cyclictest0-21swapper/020:43:310
3179099211,0cyclictest6733-21apt-get20:33:320
3179099210,21cyclictest0-21swapper/019:58:330
3179099210,20cyclictest0-21swapper/019:33:310
31801992017,2cyclictest8967-21basename19:30:013
3180199200,19cyclictest18558-21cron19:50:003
3180199200,0cyclictest16337-21apt-get20:53:323
3180199200,0cyclictest0-21swapper/320:18:323
3180199200,0cyclictest0-21swapper/319:18:313
31799992020,0cyclictest19094-21apt-get19:53:322
31799992018,1cyclictest9124-21apt20:38:312
31799992018,1cyclictest6196-21perf20:30:002
3179499200,20cyclictest0-21swapper/120:48:331
3179499200,0cyclictest9125-21apt-get20:38:311
31790992020,0cyclictest0-21swapper/020:58:320
31790992020,0cyclictest0-21swapper/020:48:330
31790992020,0cyclictest0-21swapper/019:23:310
31790992019,1cyclictest23015-21perf21:05:010
3179099200,0cyclictest0-21swapper/020:38:310
31801991919,0cyclictest0-21swapper/320:38:313
31801991919,0cyclictest0-21swapper/319:33:313
31801991917,1cyclictest0-21swapper/320:50:013
31799991919,0cyclictest0-21swapper/219:28:302
31799991917,1cyclictest3409-21sh20:25:002
31799991917,1cyclictest20578-21cron21:00:012
31794991917,1cyclictest16186-21grep19:45:001
31794991917,1cyclictest0-21swapper/120:23:311
31790991919,0cyclictest0-21swapper/020:55:010
31790991919,0cyclictest0-21swapper/020:23:320
31790991918,0cyclictest0-21swapper/019:13:310
3179099190,2cyclictest28149-21cron20:10:010
31801991818,0cyclictest28693-21apt-get20:13:323
31801991818,0cyclictest0-21swapper/321:03:333
31801991817,0cyclictest0-21swapper/320:58:323
31801991816,1cyclictest21490-21apt-get19:58:333
31799991818,0cyclictest0-21swapper/219:33:312
31794991818,0cyclictest0-21swapper/119:13:311
3179499180,17cyclictest0-21swapper/120:03:301
31790991816,1cyclictest16185-21ls19:45:000
31801991716,1cyclictest23903-21apt-get20:03:313
31799991717,0cyclictest0-21swapper/220:33:322
31799991715,1cyclictest0-21swapper/220:10:012
31794991715,1cyclictest6192-21awk20:30:001
31801991616,0cyclictest0-21swapper/320:33:313
31799991615,1cyclictest31143-21apt-get20:18:322
31799991615,0cyclictest0-21swapper/220:43:312
31799991614,1cyclictest0-21swapper/219:13:312
31790991614,1cyclictest0-21swapper/020:30:000
3179099160,16cyclictest0-21swapper/020:03:300
31801991515,0cyclictest0-21swapper/321:08:343
31799991512,2cyclictest16164-21awk19:45:002
31790991515,0cyclictest0-21swapper/019:28:290
3179099150,12cyclictest13630-21munin-node20:11:450
3180199140,14cyclictest0-21swapper/319:20:133
3179999140,14cyclictest0-21swapper/221:00:242
3179999140,14cyclictest0-21swapper/219:45:332
3179999140,14cyclictest0-21swapper/219:15:422
3179999140,0cyclictest0-21swapper/220:50:472
3179999140,0cyclictest0-21swapper/219:35:042
31794991414,0cyclictest0-21swapper/120:10:411
31794991414,0cyclictest0-21swapper/119:45:091
31794991414,0cyclictest0-21swapper/119:25:401
3179499140,14cyclictest0-21swapper/120:30:211
3179499140,14cyclictest0-21swapper/120:15:231
3179499140,14cyclictest0-21swapper/119:35:141
3179499140,0cyclictest0-21swapper/119:15:141
31790991414,0cyclictest0-21swapper/021:05:140
31790991414,0cyclictest0-21swapper/019:45:270
31790991414,0cyclictest0-21swapper/019:35:140
3179099140,14cyclictest0-21swapper/019:15:140
3179099140,0cyclictest0-21swapper/020:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional