You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 06:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sat May 16, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1214321520,1sleep312142-21ssh00:15:363
15948212098,17sleep00-21swapper/019:06:070
2502821180,0sleep30-21swapper/323:20:123
16134211898,15sleep20-21swapper/219:08:332
160662116105,6sleep10-21swapper/119:07:401
16058211394,14sleep30-21swapper/319:07:343
283502810,0sleep00-21swapper/022:14:470
325722770,0sleep20-21swapper/222:19:022
247672760,1sleep3381ktimersoftd/319:30:133
186272750,1sleep30-21swapper/322:38:243
262712260,0sleep00-21swapper/021:37:000
252322260,1sleep20-21swapper/221:35:582
1627799240,22cyclictest5909-21ssh22:25:122
150332240,0sleep00-21swapper/000:19:370
53352230,1sleep20-21swapper/221:15:132
1627899193,2cyclictest0-21swapper/321:06:043
1627899190,4cyclictest0-21swapper/322:06:013
16276991916,2cyclictest3848-21kworker/u8:121:54:041
1627899181,5cyclictest0-21swapper/320:49:043
16278991815,2cyclictest7904-21kworker/u8:120:13:053
1627899181,2cyclictest0-21swapper/320:41:043
16276991815,2cyclictest11297-21kworker/u8:023:43:051
16276991815,2cyclictest11297-21kworker/u8:023:43:041
1627899172,2cyclictest0-21swapper/322:03:043
1627899172,2cyclictest0-21swapper/321:42:043
1627899172,14cyclictest0-21swapper/320:54:053
1627899172,14cyclictest0-21swapper/300:33:053
16278991714,2cyclictest7964-21kworker/u8:100:12:043
16278991714,2cyclictest7904-21kworker/u8:120:35:053
16278991714,2cyclictest7904-21kworker/u8:120:17:043
16278991714,2cyclictest5666-21kworker/u8:200:09:053
16278991714,2cyclictest32691-21kworker/u8:200:39:043
16278991714,2cyclictest22718-21kworker/u8:122:48:043
1627899171,2cyclictest0-21swapper/320:27:053
1627899171,2cyclictest0-21swapper/319:42:043
1627899170,2cyclictest0-21swapper/319:14:053
1627899170,16cyclictest0-21swapper/319:36:053
16276991714,2cyclictest980-21kworker/u8:122:26:051
16276991714,2cyclictest6497-21kworker/u8:223:02:041
16276991714,2cyclictest24132-21kworker/u8:021:06:041
16276991714,2cyclictest18596-21kworker/u8:220:41:051
16276991714,2cyclictest17030-21kworker/u8:222:06:011
1627899161,4cyclictest0-21swapper/322:28:043
16278991613,2cyclictest10273-21kworker/u8:021:58:013
1627899161,2cyclictest0-21swapper/323:31:043
1627899161,2cyclictest0-21swapper/321:24:023
1627899161,2cyclictest0-21swapper/320:30:043
1627899160,2cyclictest0-21swapper/321:53:043
1627899160,15cyclictest0-21swapper/321:12:053
1627799160,14cyclictest6968-21http_loadtime00:10:142
16276991613,2cyclictest27168-21kworker/u8:123:56:051
16276991613,2cyclictest24132-21kworker/u8:020:49:041
16276991613,2cyclictest21760-21kworker/u8:022:12:011
16276991613,2cyclictest20160-21kworker/u8:219:26:021
16276991613,2cyclictest18596-21kworker/u8:220:54:051
16276991613,2cyclictest1685-21kworker/u8:000:23:051
16276991613,2cyclictest14470-21kworker/u8:221:44:051
16276991613,2cyclictest13952-21kworker/u8:020:27:051
1627599161,13cyclictest25702-21munin-node0
1627899151,3cyclictest0-21swapper/323:01:163
1627899151,2cyclictest0-21swapper/323:06:043
1627899151,2cyclictest0-21swapper/320:55:053
1627899151,2cyclictest0-21swapper/320:55:043
1627899151,2cyclictest0-21swapper/300:25:043
16278991512,2cyclictest22718-21kworker/u8:122:50:043
1627899151,12cyclictest31885-21ssh22:17:543
1627899150,11cyclictest0-21swapper/322:22:053
1627799150,13cyclictest0-21swapper/222:41:272
16276991512,2cyclictest8490-21kworker/u8:019:53:051
16276991512,2cyclictest8490-21kworker/u8:019:14:041
16276991512,2cyclictest7904-21kworker/u8:120:32:041
16276991512,2cyclictest7904-21kworker/u8:120:11:041
16276991512,2cyclictest5184-21kworker/u8:121:24:011
16276991512,2cyclictest20160-21kworker/u8:219:42:041
16276991512,2cyclictest17030-21kworker/u8:222:03:051
16276991512,2cyclictest0-21swapper/123:15:171
16276991510,3cyclictest0-21swapper/122:00:001
1627699150,13cyclictest26804-21grep23:21:031
1627699150,13cyclictest0-21swapper/123:30:111
1627699150,13cyclictest0-21swapper/121:47:561
16275991511,2cyclictest24887-21ssh00:30:090
1627599151,12cyclictest13642-21ssh22:32:530
16275991510,3cyclictest8399-21sh21:52:420
16275991510,3cyclictest0-21swapper/020:50:170
16275991510,3cyclictest0-21swapper/019:40:140
1627599150,13cyclictest0-21swapper/022:05:110
1627599150,13cyclictest0-21swapper/019:30:160
1627899141,2cyclictest0-21swapper/323:59:043
1627899141,2cyclictest0-21swapper/319:53:043
1627899141,12cyclictest8708-21ssh23:36:243
1627899140,2cyclictest0-21swapper/321:29:043
1627899140,12cyclictest19705-21ssh21:30:143
1627899140,12cyclictest0-21swapper/322:56:353
1627899140,10cyclictest0-21swapper/320:02:053
1627799149,3cyclictest0-21swapper/221:25:562
1627799141,2cyclictest837-21ssh00:38:572
1627799140,12cyclictest0-21swapper/223:45:562
1627799140,12cyclictest0-21swapper/223:45:552
1627799140,12cyclictest0-21swapper/219:20:112
16276991411,2cyclictest8490-21kworker/u8:019:18:041
16276991411,2cyclictest7964-21kworker/u8:100:33:051
16276991411,2cyclictest26616-21kworker/u8:121:00:051
16276991411,2cyclictest22718-21kworker/u8:123:06:041
16276991411,2cyclictest2187-21kworker/u8:220:09:041
16276991411,2cyclictest2187-21kworker/u8:220:02:041
16276991411,2cyclictest21760-21kworker/u8:022:22:051
16276991411,2cyclictest20160-21kworker/u8:219:36:041
16276991411,2cyclictest0-21swapper/123:29:461
16276991410,2cyclictest0-21swapper/122:32:141
1627699140,2cyclictest7113-21perl23:35:131
1627699140,13cyclictest0-21swapper/123:47:071
1627699140,13cyclictest0-21swapper/123:47:061
1627599149,3cyclictest16871-21ssh00:20:370
1627599142,6cyclictest0-21swapper/000:05:000
16275991410,2cyclictest5744-21sed22:25:000
1627599140,2cyclictest1774-21munin-node0
1627599140,12cyclictest18729-21kworker/u8:123:16:050
1627599140,12cyclictest0-21swapper/022:35:110
1627599140,12cyclictest0-21swapper/020:25:140
5432130,2sleep00-21swapper/000:38:300
16278991310,2cyclictest0-21swapper/322:42:223
16278991310,2cyclictest0-21swapper/319:45:283
16278991310,2cyclictest0-21swapper/300:20:173
1627899130,2cyclictest0-21swapper/321:00:043
1627899130,2cyclictest0-21swapper/320:05:113
1627899130,2cyclictest0-21swapper/319:57:043
1627899130,2cyclictest0-21swapper/319:21:043
1627899130,12cyclictest0-21swapper/323:53:443
1627899130,12cyclictest0-21swapper/323:45:143
1627899130,12cyclictest0-21swapper/323:45:133
1627899130,12cyclictest0-21swapper/323:25:553
1627899130,12cyclictest0-21swapper/323:16:403
1627899130,12cyclictest0-21swapper/323:14:353
1627899130,12cyclictest0-21swapper/322:32:583
1627899130,12cyclictest0-21swapper/322:12:593
1627899130,12cyclictest0-21swapper/321:18:143
1627899130,12cyclictest0-21swapper/320:20:043
1627899130,12cyclictest0-21swapper/300:01:263
1627799139,2cyclictest0-21swapper/221:34:062
16277991310,2cyclictest0-21swapper/223:43:022
16277991310,2cyclictest0-21swapper/223:43:022
16277991310,2cyclictest0-21swapper/222:13:162
16277991310,2cyclictest0-21swapper/219:35:002
16277991310,2cyclictest0-21swapper/200:15:112
16277991310,2cyclictest0-21swapper/200:06:162
16277991310,2cyclictest0-21swapper/200:00:192
1627799130,2cyclictest32348-21diskmemload00:30:152
1627799130,2cyclictest22640-21hostname20:45:112
1627799130,2cyclictest0-21swapper/223:59:252
1627799130,2cyclictest0-21swapper/222:20:152
1627799130,2cyclictest0-21swapper/219:20:002
1627799130,12cyclictest0-21swapper/223:06:062
1627799130,12cyclictest0-21swapper/221:11:562
1627799130,12cyclictest0-21swapper/200:28:252
1627799130,11cyclictest11852-21ssh22:30:372
16276991310,2cyclictest7904-21kworker/u8:120:15:051
16276991310,2cyclictest7623-21taskset21:17:011
16276991310,2cyclictest32348-21diskmemload22:39:311
16276991310,2cyclictest24132-21kworker/u8:021:12:061
16276991310,2cyclictest18788-21kworker/u8:200:25:041
16276991310,2cyclictest18596-21kworker/u8:220:55:041
16276991310,2cyclictest18596-21kworker/u8:220:55:041
16276991310,2cyclictest18596-21kworker/u8:220:38:051
16276991310,2cyclictest0-21swapper/121:34:131
16276991310,2cyclictest0-21swapper/119:45:131
16276991310,2cyclictest0-21swapper/100:10:011
16276991310,2cyclictest0-21swapper/100:05:331
1627699130,2cyclictest0-21swapper/123:50:171
1627699130,2cyclictest0-21swapper/123:11:401
1627699130,2cyclictest0-21swapper/122:40:051
1627699130,12cyclictest32348-21diskmemload00:35:011
1627699130,12cyclictest0-21swapper/122:57:091
1627699130,12cyclictest0-21swapper/122:46:261
1627699130,12cyclictest0-21swapper/122:15:161
1627699130,12cyclictest0-21swapper/100:02:111
1627699130,11cyclictest0-21swapper/122:51:051
16275991310,2cyclictest0-21swapper/023:49:070
16275991310,2cyclictest0-21swapper/023:49:070
16275991310,2cyclictest0-21swapper/023:23:570
16275991310,2cyclictest0-21swapper/022:52:180
16275991310,2cyclictest0-21swapper/022:45:510
16275991310,2cyclictest0-21swapper/021:27:080
16275991310,2cyclictest0-21swapper/021:20:170
16275991310,2cyclictest0-21swapper/021:15:180
1627599130,2cyclictest9624-21timerandwakeup20:11:010
1627599130,2cyclictest0-21swapper/023:36:010
1627599130,2cyclictest0-21swapper/022:26:030
1627599130,2cyclictest0-21swapper/020:55:100
1627599130,2cyclictest0-21swapper/020:55:100
1627599130,2cyclictest0-21swapper/020:40:130
1627599130,1cyclictest0-21swapper/021:30:170
1627599130,12cyclictest0-21swapper/021:46:470
1627599130,11cyclictest32348-21diskmemload22:02:560
1627599130,11cyclictest21528-21ssh22:41:020
1627599130,11cyclictest0-21swapper/023:25:180
1627599130,11cyclictest0-21swapper/023:12:290
1627599130,11cyclictest0-21swapper/023:02:480
1627599130,11cyclictest0-21swapper/022:58:170
1627599130,11cyclictest0-21swapper/022:15:340
4362120,2sleep2448-21ssh22:53:512
27932120,2sleep30-21swapper/321:46:263
1627899129,2cyclictest0-21swapper/323:40:263
1627899129,2cyclictest0-21swapper/323:40:263
1627899129,2cyclictest0-21swapper/321:35:203
1627899123,2cyclictest0-21swapper/319:26:013
1627899120,2cyclictest0-21swapper/319:15:143
1627799129,2cyclictest32348-21diskmemload21:22:522
1627799129,2cyclictest0-21swapper/223:25:332
1627799129,2cyclictest0-21swapper/223:24:572
1627799129,2cyclictest0-21swapper/222:56:072
1627799129,2cyclictest0-21swapper/222:49:052
1627799129,2cyclictest0-21swapper/222:37:562
1627799129,2cyclictest0-21swapper/221:48:582
1627799129,2cyclictest0-21swapper/219:56:032
1627799127,3cyclictest20946-21fschecks_count20:40:132
1627799123,6cyclictest0-21swapper/220:51:022
1627799122,7cyclictest4556-21metacity22:07:582
1627799122,7cyclictest0-21swapper/219:35:022
1627799120,2cyclictest0-21swapper/221:50:292
1627799120,11cyclictest0-21swapper/223:51:572
1627799120,11cyclictest0-21swapper/223:31:102
1627799120,11cyclictest0-21swapper/223:10:332
1627799120,11cyclictest0-21swapper/219:25:142
1627799120,11cyclictest0-21swapper/200:21:152
1627799120,10cyclictest9777-21sh23:38:102
1627699129,2cyclictest0-21swapper/121:28:331
1627699129,2cyclictest0-21swapper/100:15:131
1627699120,11cyclictest0-21swapper/121:35:211
1627699120,11cyclictest0-21swapper/120:21:031
1627599129,2cyclictest0-21swapper/023:41:590
1627599129,2cyclictest0-21swapper/023:41:580
1627599129,2cyclictest0-21swapper/021:58:240
1627599129,2cyclictest0-21swapper/021:42:220
1627599122,7cyclictest0-21swapper/019:20:000
1627599120,2cyclictest0-21swapper/021:05:380
1627599120,2cyclictest0-21swapper/020:36:010
1627599120,2cyclictest0-21swapper/019:25:160
1627599120,11cyclictest0-21swapper/023:05:110
1627599120,11cyclictest0-21swapper/021:10:190
1627599120,11cyclictest0-21swapper/019:55:140
1627599120,11cyclictest0-21swapper/000:27:480
1627599120,11cyclictest0-21swapper/000:10:570
216442110,2sleep00-21swapper/023:50:200
173262110,1sleep20-21swapper/219:10:192
1627799118,2cyclictest17533-21ssh22:02:222
1627799118,2cyclictest12188-21ssh21:56:112
1627799112,5cyclictest0-21swapper/220:16:012
1627799111,8cyclictest4556-21metacity20:02:592
1627799110,10cyclictest32348-21diskmemload23:00:082
1627799110,10cyclictest0-21swapper/223:15:422
1627699118,2cyclictest8490-21kworker/u8:019:57:041
1627699118,2cyclictest0-21swapper/119:20:141
1627699110,9cyclictest0-21swapper/119:30:141
1627599116,3cyclictest28710-21cpu21:00:140
1627599112,6cyclictest0-21swapper/020:02:010
1627599112,4cyclictest0-21swapper/019:10:010
1627599111,6cyclictest0-21swapper/019:35:080
1627599110,10cyclictest0-21swapper/023:30:480
295592100,1sleep2301ktimersoftd/221:40:222
1627799102,5cyclictest0-21swapper/219:44:582
1627799101,5cyclictest0-21swapper/219:55:012
1627799100,7cyclictest4562-21gdm-simple-gree19:48:582
1627599107,2cyclictest0-21swapper/020:30:160
1627599107,2cyclictest0-21swapper/019:15:130
1627599105,3cyclictest12173-21cat20:20:010
1627599100,9cyclictest7904-21kworker/u8:120:45:040
1627599100,7cyclictest0-21swapper/020:21:580
162779994,3cyclictest18217-21turbostat.cron20:39:552
162779994,3cyclictest16716-21grep20:30:132
162779994,3cyclictest0-21swapper/220:55:162
162779994,3cyclictest0-21swapper/220:55:162
162779992,6cyclictest0-21swapper/220:26:022
162779992,6cyclictest0-21swapper/220:06:012
162779990,7cyclictest0-21swapper/220:14:582
162759994,3cyclictest32660-21telnet19:50:130
162759993,4cyclictest31801-21grep19:46:030
162779983,3cyclictest32496-21date21:10:002
162779983,3cyclictest28544-21chrt21:00:102
162779983,3cyclictest13344-21wc20:20:182
162759983,3cyclictest6910-21grep20:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional