You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 18:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Jan 03, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32027211593,15sleep00-21swapper/007:05:270
30898211494,15sleep20-21swapper/207:05:042
32362210290,7sleep30-21swapper/307:05:453
3247729887,6sleep10-21swapper/107:07:171
183802820,1sleep30-21swapper/312:18:323
25222750,1sleep2301ktimersoftd/212:00:162
241932690,1sleep20-21swapper/209:18:022
241932690,1sleep20-21swapper/209:18:012
101312670,0sleep10-21swapper/111:30:321
90642240,2sleep33271899cyclictest10:52:343
3271899201,2cyclictest0-21swapper/307:15:133
3271899200,2cyclictest0-21swapper/312:35:123
32716991916,2cyclictest17649-21kworker/u8:111:04:051
32715991916,2cyclictest10034-21kworker/u8:112:12:040
32717991815,2cyclictest15226-21kworker/u8:012:28:052
3271699181,15cyclictest0-21swapper/111:45:241
3271699173,2cyclictest16745-21diskmemload10:49:381
3271699171,3cyclictest0-21swapper/107:15:251
32716991713,2cyclictest221ktimersoftd/109:13:031
3271699171,13cyclictest0-21swapper/110:25:231
3271699170,2cyclictest21-21rcuc/112:12:041
89732160,0sleep00-21swapper/009:37:360
89732160,0sleep00-21swapper/009:37:350
3271799161,3cyclictest0-21swapper/211:51:242
32717991613,2cyclictest27925-21kworker/u8:010:43:032
32717991613,2cyclictest21392-21kworker/u8:209:20:042
32717991613,2cyclictest16580-21kworker/u8:009:11:042
3271799160,2cyclictest0-21swapper/212:12:042
32716991612,2cyclictest0-21swapper/112:35:121
32716991611,4cyclictest15226-21kworker/u8:012:16:051
32716991611,4cyclictest10427-21kworker/u8:008:54:041
3271699161,13cyclictest25265-21apt-get09:20:061
3271699161,13cyclictest0-21swapper/110:05:431
32715991613,2cyclictest16580-21kworker/u8:009:49:040
32718991512,2cyclictest0-21swapper/311:07:063
3271899151,12cyclictest14003-21ssh11:35:253
3271899150,3cyclictest0-21swapper/310:07:073
3271899150,14cyclictest0-21swapper/309:44:163
32717991512,2cyclictest32246-21kworker/u8:210:09:042
32717991512,2cyclictest19095-21kworker/u8:108:10:042
32717991512,2cyclictest16580-21kworker/u8:009:45:052
3271799150,2cyclictest0-21swapper/209:42:322
3271799150,13cyclictest0-21swapper/209:54:452
32716991512,2cyclictest16580-21kworker/u8:009:43:041
32716991510,3cyclictest26505-21irqstats11:50:191
32715991512,2cyclictest4703-21kworker/u8:309:40:040
32715991512,2cyclictest16745-21diskmemload10:49:270
32715991512,2cyclictest15446-21kworker/u8:012:07:040
32715991512,2cyclictest15446-21kworker/u8:011:38:040
32715991512,2cyclictest0-21swapper/011:04:180
3271599150,13cyclictest0-21swapper/009:13:590
3271899141,2cyclictest11308-21df_inode08:55:143
32718991411,2cyclictest0-21swapper/312:29:173
32718991411,2cyclictest0-21swapper/311:45:163
32718991411,2cyclictest0-21swapper/307:10:253
3271899140,2cyclictest0-21swapper/311:26:163
3271899140,2cyclictest0-21swapper/311:15:113
3271899140,2cyclictest0-21swapper/308:15:173
3271899140,13cyclictest0-21swapper/310:42:263
3271899140,12cyclictest0-21swapper/312:14:453
3271899140,12cyclictest0-21swapper/311:31:443
3271899140,12cyclictest0-21swapper/310:59:443
3271899140,12cyclictest0-21swapper/310:26:413
32717991411,2cyclictest828-21kworker/u8:108:49:042
32717991411,2cyclictest6193-21kworker/u8:110:56:042
32717991411,2cyclictest27925-21kworker/u8:010:48:042
32717991411,2cyclictest0-21swapper/212:35:132
32717991411,2cyclictest0-21swapper/210:35:232
32717991411,2cyclictest0-21swapper/209:27:472
3271799141,11cyclictest25450-21ssh09:56:102
3271799140,3cyclictest8442-21ssh10:15:032
3271799140,2cyclictest16745-21diskmemload11:37:242
3271799140,2cyclictest0-21swapper/211:43:332
3271799140,13cyclictest16745-21diskmemload09:36:432
3271799140,13cyclictest16745-21diskmemload09:36:422
3271799140,13cyclictest0-21swapper/211:24:332
3271699149,3cyclictest29212-21cut12:30:181
3271699149,3cyclictest0-21swapper/112:27:351
3271699141,3cyclictest18594-21apt-get07:54:221
32716991411,2cyclictest17649-21kworker/u8:111:22:041
32716991411,2cyclictest16580-21kworker/u8:009:15:041
32716991411,2cyclictest16580-21kworker/u8:009:15:031
32716991411,2cyclictest0-21swapper/112:04:541
32716991411,2cyclictest0-21swapper/110:55:141
32716991411,2cyclictest0-21swapper/109:36:451
32716991411,2cyclictest0-21swapper/109:36:441
3271699141,11cyclictest4039-21ssh11:25:111
3271699141,11cyclictest0-21swapper/108:10:161
32716991410,2cyclictest6555-21munin-run08:45:001
32716991410,2cyclictest0-21swapper/111:40:131
3271699140,2cyclictest0-21swapper/110:30:241
3271599149,3cyclictest6675-21snmpd10:28:210
3271599149,3cyclictest19231-21munin-node0
32715991411,2cyclictest6431-21nscd11:52:280
32715991411,2cyclictest22627-21ssh11:08:510
32715991411,2cyclictest2166-21kworker/u8:207:15:050
32715991411,2cyclictest16580-21kworker/u8:010:21:040
32715991411,2cyclictest11538-21ssh11:33:070
32715991411,2cyclictest10398-21kworker/u8:210:16:040
32715991411,2cyclictest0-21swapper/011:55:570
32715991411,2cyclictest0-21swapper/010:58:570
32715991411,2cyclictest0-21swapper/010:05:070
32715991411,2cyclictest0-21swapper/010:03:310
32715991411,2cyclictest0-21swapper/008:25:170
32715991410,2cyclictest30779-21iostat_ios10:40:150
32715991410,2cyclictest0-21swapper/011:49:390
3271599140,2cyclictest0-21swapper/009:30:180
3271599140,2cyclictest0-21swapper/009:25:170
3271599140,13cyclictest16745-21diskmemload12:25:370
3271599140,13cyclictest16745-21diskmemload10:30:270
3271599140,13cyclictest0-21swapper/011:29:580
3271599140,13cyclictest0-21swapper/011:16:580
3271599140,13cyclictest0-21swapper/011:10:570
3271599140,13cyclictest0-21swapper/009:20:170
3271599140,12cyclictest29853-21ssh12:30:430
3271599140,12cyclictest2025-21ssh12:00:110
3271599140,12cyclictest0-21swapper/011:40:210
3271599140,12cyclictest0-21swapper/009:57:460
3271599140,12cyclictest0-21swapper/009:16:000
3271599140,12cyclictest0-21swapper/009:15:590
3271599140,12cyclictest0-21swapper/008:35:100
127452140,1sleep00-21swapper/009:00:010
32718991310,2cyclictest829-21ssh11:20:213
32718991310,2cyclictest0-21swapper/312:09:583
32718991310,2cyclictest0-21swapper/311:04:423
32718991310,2cyclictest0-21swapper/310:23:453
32718991310,2cyclictest0-21swapper/310:16:493
3271899130,2cyclictest7079-21cpuspeed_turbos08:45:133
3271899130,2cyclictest13519-21iostat_ios07:40:153
3271899130,2cyclictest0-21swapper/309:37:373
3271899130,2cyclictest0-21swapper/309:37:363
3271899130,2cyclictest0-21swapper/309:29:023
3271899130,2cyclictest0-21swapper/309:17:553
3271899130,2cyclictest0-21swapper/309:17:553
3271899130,2cyclictest0-21swapper/308:30:113
3271899130,12cyclictest30078-21munin-node3
3271899130,12cyclictest0-21swapper/312:03:303
3271899130,12cyclictest0-21swapper/311:43:063
3271899130,12cyclictest0-21swapper/310:45:223
3271899130,12cyclictest0-21swapper/310:39:073
3271899130,12cyclictest0-21swapper/309:13:553
32717991310,2cyclictest4294-21kworker/u8:107:39:042
32717991310,2cyclictest27142-21kworker/u8:208:23:042
32717991310,2cyclictest27068-21kworker/u8:110:02:042
32717991310,2cyclictest22750-21kworker/u8:211:13:052
32717991310,2cyclictest2166-21kworker/u8:207:31:032
32717991310,2cyclictest15446-21kworker/u8:012:05:042
32717991310,2cyclictest15446-21kworker/u8:011:48:042
32717991310,2cyclictest0-21swapper/211:30:572
3271799130,2cyclictest0-21swapper/212:24:072
3271799130,2cyclictest0-21swapper/211:18:572
3271799130,2cyclictest0-21swapper/211:02:052
3271799130,2cyclictest0-21swapper/210:54:352
3271799130,2cyclictest0-21swapper/210:20:202
3271799130,12cyclictest0-21swapper/208:25:262
3271799130,11cyclictest16745-21diskmemload11:07:132
3271699131,4cyclictest4106-21cut10:10:131
32716991310,2cyclictest15038-21kworker/u8:109:53:031
32716991310,2cyclictest12942-21kworker/u8:207:44:051
32716991310,2cyclictest10427-21kworker/u8:008:38:041
32716991310,2cyclictest0-21swapper/111:37:431
32716991310,2cyclictest0-21swapper/111:13:541
32716991310,2cyclictest0-21swapper/110:23:241
3271699130,2cyclictest16745-21diskmemload09:49:051
3271699130,2cyclictest0-21swapper/112:06:571
3271699130,2cyclictest0-21swapper/111:59:541
3271699130,2cyclictest0-21swapper/110:52:091
3271699130,12cyclictest0-21swapper/110:39:581
3271699130,12cyclictest0-21swapper/109:26:441
3271699130,11cyclictest16745-21diskmemload09:31:191
3271699130,11cyclictest0-21swapper/110:00:241
32715991310,2cyclictest32246-21kworker/u8:210:10:040
32715991310,2cyclictest0-21swapper/012:22:420
32715991310,2cyclictest0-21swapper/011:20:150
32715991310,2cyclictest0-21swapper/010:50:280
32715991310,2cyclictest0-21swapper/010:37:490
32715991310,2cyclictest0-21swapper/007:50:120
3271599130,2cyclictest0-21swapper/012:19:260
3271599130,12cyclictest0-21swapper/007:40:130
3271899129,2cyclictest0-21swapper/310:00:433
3271899129,2cyclictest0-21swapper/309:20:073
3271899129,2cyclictest0-21swapper/308:25:193
3271899129,2cyclictest0-21swapper/308:00:183
3271899120,2cyclictest0-21swapper/312:31:383
3271899120,2cyclictest0-21swapper/312:22:183
3271899120,2cyclictest0-21swapper/311:11:413
3271899120,2cyclictest0-21swapper/309:34:123
3271899120,11cyclictest0-21swapper/311:51:463
3271899120,11cyclictest0-21swapper/310:30:193
3271899120,11cyclictest0-21swapper/309:56:193
3271899120,11cyclictest0-21swapper/309:52:113
3271899120,11cyclictest0-21swapper/308:20:153
3271899120,11cyclictest0-21swapper/308:05:213
3271799129,2cyclictest27142-21kworker/u8:208:18:052
3271799129,2cyclictest19095-21kworker/u8:108:06:052
3271799129,2cyclictest19095-21kworker/u8:108:00:042
3271799129,2cyclictest10427-21kworker/u8:007:57:042
3271799129,2cyclictest10427-21kworker/u8:007:52:052
3271799129,2cyclictest10398-21kworker/u8:210:25:032
3271799129,2cyclictest0-21swapper/212:30:432
3271799129,2cyclictest0-21swapper/212:16:352
3271799129,2cyclictest0-21swapper/211:29:572
3271799129,2cyclictest0-21swapper/210:30:152
3271799120,2cyclictest0-21swapper/210:10:572
3271799120,11cyclictest0-21swapper/209:05:172
3271699129,2cyclictest27142-21kworker/u8:208:25:031
3271699129,2cyclictest26481-21kworker/u8:107:12:041
3271699129,2cyclictest12391-21kworker/u8:208:59:051
3271699129,2cyclictest10427-21kworker/u8:007:49:031
3271699129,2cyclictest0-21swapper/109:55:151
3271699121,9cyclictest6608-21apt-get07:25:121
3271699121,9cyclictest0-21swapper/109:05:091
3271699121,9cyclictest0-21swapper/107:55:161
3271699121,9cyclictest0-21swapper/107:20:181
3271699121,7cyclictest16745-21diskmemload11:15:221
3271699120,2cyclictest16745-21diskmemload10:17:051
3271699120,2cyclictest0-21swapper/109:00:191
3271699120,2cyclictest0-21swapper/108:30:191
3271699120,11cyclictest0-21swapper/111:07:161
3271699120,11cyclictest0-21swapper/108:15:251
3271699120,11cyclictest0-21swapper/107:35:181
3271699120,10cyclictest0-21swapper/110:40:071
3271599129,2cyclictest0-21swapper/009:05:220
3271599129,2cyclictest0-21swapper/008:50:300
3271599129,2cyclictest0-21swapper/008:45:200
3271599129,2cyclictest0-21swapper/007:25:170
3271599120,2cyclictest0-21swapper/008:05:200
3271599120,2cyclictest0-21swapper/007:35:240
3271599120,11cyclictest0-21swapper/012:36:250
3271599120,11cyclictest0-21swapper/007:10:280
3271899118,2cyclictest19432-21munin-node3
3271899118,2cyclictest0-21swapper/307:54:263
3271899118,2cyclictest0-21swapper/307:30:233
3271899110,2cyclictest0-21swapper/309:45:223
3271799118,2cyclictest0-21swapper/209:30:542
3271799118,2cyclictest0-21swapper/208:50:242
3271799118,2cyclictest0-21swapper/208:30:252
3271799118,2cyclictest0-21swapper/207:45:182
3271799110,3cyclictest31884-21ssh11:55:522
3271699118,2cyclictest2166-21kworker/u8:207:30:041
3271699111,8cyclictest6772-21apt-get08:45:111
3271699111,8cyclictest20638-21grep12:20:211
3271699111,8cyclictest0-21swapper/108:10:011
3271599118,2cyclictest828-21kworker/u8:108:33:050
3271599118,2cyclictest27142-21kworker/u8:208:21:040
3271599118,2cyclictest0-21swapper/007:30:180
301322110,2sleep130217-21smartctl08:20:231
3271899107,2cyclictest0-21swapper/309:03:053
3271899107,2cyclictest0-21swapper/308:15:003
3271899100,9cyclictest10427-21kworker/u8:007:35:043
3271899100,7cyclictest0-21swapper/310:11:593
3271799107,2cyclictest4294-21kworker/u8:107:24:042
3271799107,2cyclictest15679-21kworker/u8:007:17:052
3271599107,2cyclictest19095-21kworker/u8:108:03:040
3271599107,2cyclictest10427-21kworker/u8:007:55:050
3271599107,2cyclictest0-21swapper/007:24:330
164352100,2sleep30-21swapper/307:47:283
327189990,6cyclictest0-21swapper/309:09:593
327189990,6cyclictest0-21swapper/308:53:583
327189990,6cyclictest0-21swapper/308:37:583
327179994,3cyclictest1635-21grep07:10:252
327179992,3cyclictest4583-21wc08:40:002
327159996,2cyclictest27142-21kworker/u8:208:16:040
327159996,2cyclictest12391-21kworker/u8:209:02:040
327159990,8cyclictest0-21swapper/008:44:380
12446290,2sleep20-21swapper/208:56:432
327189985,2cyclictest0-21swapper/308:40:013
327189984,2cyclictest6624-21aten2.4_r3power07:25:133
327189983,3cyclictest0-21swapper/307:20:123
327179985,2cyclictest0-21swapper/209:00:002
327179984,2cyclictest277-21jbd2/sda1-808:40:062
327179983,3cyclictest6634-21aten2.4_r3power07:25:132
327179983,3cyclictest13469-21if_eth007:40:162
327169980,2cyclictest0-21swapper/108:00:121
327159984,3cyclictest6431-21nscd07:45:150
327159980,1cyclictest0-21swapper/008:13:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional