You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 22:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jun 01, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
945099250,24cyclictest3199-21diskmemload11:08:282
945099250,24cyclictest3199-21diskmemload10:13:212
945099250,24cyclictest3199-21diskmemload09:58:392
945099250,24cyclictest1073-21cron08:00:002
9446992523,1cyclictest0-21swapper/110:58:391
944699250,24cyclictest4682-21apt-get10:43:361
944699250,24cyclictest3199-21diskmemload12:09:531
944699250,24cyclictest0-21swapper/111:12:121
9442992523,1cyclictest1-21systemd07:40:000
944299250,24cyclictest3199-21diskmemload11:23:450
944299250,24cyclictest3199-21diskmemload10:38:110
944299250,24cyclictest1797-21sh11:10:000
944299250,24cyclictest14373-21apt-get12:23:380
944299250,24cyclictest0-21swapper/011:45:000
944299250,24cyclictest0-21swapper/009:21:270
9454992423,0cyclictest3199-21diskmemload12:25:213
945499240,23cyclictest3199-21diskmemload11:11:543
945499240,23cyclictest3199-21diskmemload10:50:123
945499240,23cyclictest0-21swapper/312:34:423
945499240,23cyclictest0-21swapper/310:46:133
945499240,23cyclictest0-21swapper/310:24:263
945499240,0cyclictest0-21swapper/310:14:413
9450992420,1cyclictest0-21swapper/211:31:282
945099240,23cyclictest26301-21apt-get11:03:362
945099240,23cyclictest0-21swapper/211:50:302
945099240,23cyclictest0-21swapper/211:46:302
945099240,23cyclictest0-21swapper/209:37:222
945099240,1cyclictest0-21swapper/212:09:362
944699240,2cyclictest19014-21perf07:30:011
944699240,0cyclictest3199-21diskmemload11:34:081
944299242,21cyclictest62550irq/127-eno110:23:310
944299240,2cyclictest29732-21ssh12:37:470
944299240,24cyclictest3199-21diskmemload10:02:470
944299240,24cyclictest0-21swapper/011:33:560
944299240,23cyclictest3199-21diskmemload10:17:300
944299240,23cyclictest3199-21diskmemload10:06:260
944299240,23cyclictest3199-21diskmemload09:55:080
944299240,23cyclictest20410-21hddtemp_smartct12:28:390
944299240,23cyclictest17081-21if_err_eno109:53:410
944299240,23cyclictest0-21swapper/009:49:370
944299240,23cyclictest0-21swapper/009:38:010
944299240,22cyclictest7498-21rm11:45:550
944299240,0cyclictest0-21swapper/010:13:370
9454992323,0cyclictest0-21swapper/311:45:273
9454992323,0cyclictest0-21swapper/310:09:533
9454992323,0cyclictest0-21swapper/309:29:543
9454992322,1cyclictest3199-21diskmemload11:55:293
9454992321,1cyclictest2289-21ssh11:40:583
945499231,1cyclictest14288-21taskset11:53:113
945499230,2cyclictest1362-21sh11:09:183
945499230,23cyclictest3199-21diskmemload11:25:393
945499230,23cyclictest0-21swapper/312:37:113
945499230,23cyclictest0-21swapper/312:00:423
945499230,23cyclictest0-21swapper/309:43:263
945499230,23cyclictest0-21swapper/309:19:403
945499230,22cyclictest3199-21diskmemload11:22:153
945499230,22cyclictest3199-21diskmemload10:26:063
945499230,22cyclictest29074-21ssh11:35:373
945499230,22cyclictest2662-21ssh12:12:423
945499230,22cyclictest26540-21ssh11:33:383
945499230,0cyclictest3199-21diskmemload12:22:203
945499230,0cyclictest0-21swapper/309:23:403
9450992323,0cyclictest0-21swapper/210:01:182
9450992323,0cyclictest0-21swapper/209:26:012
9450992321,2cyclictest32246-21ssh10:38:372
9450992321,1cyclictest0-21swapper/210:31:372
945099230,2cyclictest1333-21runrttasks10:08:432
945099230,23cyclictest0-21swapper/212:01:302
945099230,23cyclictest0-21swapper/211:23:362
945099230,22cyclictest3199-21diskmemload09:53:392
945099230,22cyclictest3199-21diskmemload09:23:402
945099230,22cyclictest25977-21rm09:31:332
945099230,22cyclictest19028-21ssh11:26:282
945099230,22cyclictest15977-21apt08:30:002
945099230,22cyclictest0-21swapper/212:15:382
945099230,0cyclictest3199-21diskmemload12:25:182
945099230,0cyclictest0-21swapper/212:20:372
945099230,0cyclictest0-21swapper/212:12:052
945099230,0cyclictest0-21swapper/210:52:122
945099230,0cyclictest0-21swapper/209:13:032
9446992323,0cyclictest3199-21diskmemload11:39:201
9446992323,0cyclictest0-21swapper/112:31:461
9446992323,0cyclictest0-21swapper/112:28:361
9446992323,0cyclictest0-21swapper/111:44:431
9446992323,0cyclictest0-21swapper/110:51:051
9446992323,0cyclictest0-21swapper/110:25:291
9446992323,0cyclictest0-21swapper/110:02:081
9446992323,0cyclictest0-21swapper/109:39:391
9446992323,0cyclictest0-21swapper/109:18:191
9446992321,1cyclictest19808-21ssh09:25:091
9446992321,1cyclictest0-21swapper/110:21:191
9446992321,1cyclictest0-21swapper/110:11:061
9446992321,1cyclictest0-21swapper/110:08:441
9446992321,1cyclictest0-21swapper/108:30:001
9446992320,2cyclictest0-21swapper/112:15:021
944699230,2cyclictest30041-21runrttasks11:06:231
944699230,23cyclictest0-21swapper/111:26:281
944699230,23cyclictest0-21swapper/111:20:501
944699230,22cyclictest9302-21ssh09:46:031
944699230,22cyclictest3687-21rm09:10:271
944699230,22cyclictest3199-21diskmemload09:22:591
944699230,22cyclictest21004-21sh11:58:421
944699230,22cyclictest0-21swapper/109:33:541
944699230,22cyclictest0-21swapper/107:55:001
944699230,0cyclictest3199-21diskmemload09:56:311
944699230,0cyclictest0-21swapper/110:18:221
944699230,0cyclictest0-21swapper/109:51:171
9442992323,0cyclictest9825-21apt-get11:18:380
9442992323,0cyclictest0-21swapper/012:02:180
9442992323,0cyclictest0-21swapper/011:12:440
9442992323,0cyclictest0-21swapper/010:26:280
9442992322,1cyclictest62550irq/127-eno109:31:140
9442992321,2cyclictest0-21swapper/010:31:390
944299230,2cyclictest2309-21ssh12:12:030
944299230,23cyclictest3199-21diskmemload09:44:520
944299230,23cyclictest0-21swapper/011:52:240
944299230,23cyclictest0-21swapper/011:38:510
944299230,22cyclictest9241-21ssh09:15:510
944299230,22cyclictest14183-21cron07:20:010
944299230,22cyclictest13287-21rm10:50:320
944299230,0cyclictest3199-21diskmemload10:41:400
944299230,0cyclictest3199-21diskmemload09:13:300
9454992222,0cyclictest0-21swapper/311:00:483
9454992222,0cyclictest0-21swapper/307:28:363
9454992220,1cyclictest9281-21ssh10:16:593
9454992220,1cyclictest3199-21diskmemload09:32:433
9454992220,1cyclictest0-21swapper/310:30:493
9454992220,1cyclictest0-21swapper/309:57:113
945499220,22cyclictest0-21swapper/309:35:233
945499220,21cyclictest29586-21idleruntime-cro10:05:003
945499220,21cyclictest0-21swapper/311:15:093
945499220,21cyclictest0-21swapper/309:11:303
945499220,1cyclictest606-21dbus-daemon08:10:013
945499220,1cyclictest0-21swapper/309:52:433
945499220,1cyclictest0-21swapper/309:47:013
945499220,1cyclictest0-21swapper/308:25:003
945499220,0cyclictest0-21swapper/310:41:393
9450992222,0cyclictest3199-21diskmemload11:11:542
9450992222,0cyclictest3199-21diskmemload10:27:412
9450992222,0cyclictest3199-21diskmemload10:16:272
9450992222,0cyclictest0-21swapper/212:30:302
9450992220,1cyclictest3265-21sh09:40:032
9450992220,1cyclictest2046-21sh11:40:392
9450992220,1cyclictest0-21swapper/211:55:212
9450992219,0cyclictest0-21swapper/209:45:062
945099220,21cyclictest0-21swapper/210:57:352
945099220,21cyclictest0-21swapper/210:40:582
945099220,21cyclictest0-21swapper/209:03:362
945099220,1cyclictest31115-21awk07:55:002
945099220,0cyclictest0-21swapper/210:45:422
9446992221,1cyclictest7435-21rm11:15:031
9446992221,1cyclictest4506-21apt-get08:08:361
9446992221,1cyclictest30483-21ssh10:36:391
9446992221,1cyclictest0-21swapper/112:01:081
9446992220,1cyclictest25573-21sh08:50:011
944699220,22cyclictest605-21avahi-daemon10:47:311
944699220,22cyclictest25620-21ssh10:32:251
944699220,21cyclictest0-21swapper/112:14:451
944699220,21cyclictest0-21swapper/111:00:171
944699220,1cyclictest26115-21apt-get08:53:371
944699220,1cyclictest0-21swapper/109:43:281
9442992222,0cyclictest0-21swapper/010:55:270
9442992222,0cyclictest0-21swapper/010:48:100
9442992221,1cyclictest3199-21diskmemload11:01:270
9442992221,1cyclictest0-21swapper/009:25:240
944299220,22cyclictest0-21swapper/012:16:360
944299220,21cyclictest0-21swapper/011:55:420
944299220,21cyclictest0-21swapper/011:25:190
944299220,21cyclictest0-21swapper/009:05:020
944299220,21cyclictest0-21swapper/007:13:370
944299220,1cyclictest1110-21perf08:00:000
944299220,0cyclictest0-21swapper/008:38:360
9454992120,1cyclictest26115-21apt-get08:53:373
945499210,20cyclictest19558-21apt-get07:33:363
945499210,20cyclictest14767-21apt-get07:23:363
945499210,20cyclictest0-21swapper/308:03:393
945499210,1cyclictest0-21swapper/308:40:003
9450992119,1cyclictest28506-21apt-get08:58:372
9450992119,1cyclictest0-21swapper/211:35:272
945099210,21cyclictest3199-21diskmemload11:16:242
945099210,20cyclictest3199-21diskmemload10:20:232
945099210,20cyclictest21954-21apt-get07:38:362
945099210,0cyclictest0-21swapper/208:03:392
9446992121,0cyclictest0-21swapper/107:38:361
944699210,21cyclictest0-21swapper/112:21:121
944699210,21cyclictest0-21swapper/111:45:271
944699210,21cyclictest0-21swapper/108:23:371
944699210,20cyclictest0-21swapper/108:33:371
9442992121,0cyclictest0-21swapper/012:31:200
9442992120,1cyclictest28506-21apt-get08:58:370
9442992120,0cyclictest0-21swapper/008:43:380
9442992119,1cyclictest26346-21perf07:45:000
9442992119,1cyclictest15989-21perf08:30:000
944299210,21cyclictest16626-21perf07:25:010
944299210,21cyclictest0-21swapper/012:05:180
944299210,21cyclictest0-21swapper/008:33:370
944299210,21cyclictest0-21swapper/008:13:370
9454992020,0cyclictest0-21swapper/307:53:363
9454992018,1cyclictest0-21swapper/308:28:363
945499200,20cyclictest21327-21apt-get08:43:383
945499200,0cyclictest0-21swapper/308:18:363
945499200,0cyclictest0-21swapper/307:43:363
945499200,0cyclictest0-21swapper/307:18:353
945499200,0cyclictest0-21swapper/307:13:373
9450992019,0cyclictest12351-21apt-get07:18:352
9450992018,1cyclictest6385-21munin-run08:10:012
945099200,0cyclictest0-21swapper/207:43:362
945099200,0cyclictest0-21swapper/207:23:362
9446992020,0cyclictest0-21swapper/107:13:371
9446992019,1cyclictest9299-21apt-get08:18:361
944699200,0cyclictest0-21swapper/108:38:361
9442992018,1cyclictest783-21snmpd07:33:360
9442992018,1cyclictest1116-21apt-get08:00:020
944299200,1cyclictest45102sleep008:08:360
9450991919,0cyclictest9957-21apt-get07:13:372
9450991919,0cyclictest23715-21apt-get08:48:362
9450991917,1cyclictest0-21swapper/209:10:002
9446991919,0cyclictest0-21swapper/107:23:361
9446991918,0cyclictest0-21swapper/107:48:361
9442991919,0cyclictest0-21swapper/008:53:370
9442991919,0cyclictest0-21swapper/008:18:360
9442991919,0cyclictest0-21swapper/007:48:360
9454991815,2cyclictest607-21in:imuxsock08:50:003
9450991818,0cyclictest0-21swapper/208:53:372
9446991818,0cyclictest0-21swapper/107:18:351
9442991818,0cyclictest0-21swapper/009:03:360
9442991816,1cyclictest13567-21apt08:25:000
9454991717,0cyclictest0-21swapper/308:33:373
945499170,4cyclictest0-21swapper/307:58:353
9450991717,0cyclictest0-21swapper/208:43:382
9450991716,0cyclictest0-21swapper/208:18:362
945099170,0cyclictest0-21swapper/208:38:362
9446991717,0cyclictest0-21swapper/108:45:001
9446991717,0cyclictest0-21swapper/108:13:371
9446991715,1cyclictest30390-21perf09:00:011
9450991616,0cyclictest0-21swapper/207:48:362
9450991614,1cyclictest0-21swapper/207:28:422
9446991616,0cyclictest0-21swapper/107:58:361
944699160,16cyclictest0-21swapper/109:05:021
9454991515,0cyclictest0-21swapper/308:58:363
9454991514,1cyclictest26870-21apt-get07:48:363
945499150,1cyclictest0-21swapper/309:04:413
9446991515,0cyclictest24474-21apt-get07:43:361
945499140,14cyclictest0-21swapper/309:05:033
945499140,14cyclictest0-21swapper/308:12:043
945499140,14cyclictest0-21swapper/307:35:053
945099140,14cyclictest0-21swapper/208:30:012
945099140,14cyclictest0-21swapper/208:20:522
945099140,14cyclictest0-21swapper/207:30:202
945099140,0cyclictest0-21swapper/208:10:422
944699140,0cyclictest0-21swapper/109:00:041
9442991414,0cyclictest0-21swapper/008:47:090
944299140,14cyclictest0-21swapper/007:26:290
944299140,0cyclictest0-21swapper/007:50:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional