You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 05:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Fri Mar 20, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16642212097,18sleep00-21swapper/019:08:570
16598211596,14sleep30-21swapper/319:08:243
16503210892,11sleep20-21swapper/219:07:112
1493729482,6sleep10-21swapper/119:05:091
109922860,0sleep30-21swapper/323:40:123
312602810,0sleep20-21swapper/200:01:012
24302740,0sleep20-21swapper/223:31:022
173202680,0sleep20-21swapper/223:12:512
235512520,1sleep023549-21ssh21:39:050
302932250,0sleep00-21swapper/023:26:030
181982240,1sleep10-21swapper/122:06:041
1675199210,19cyclictest0-21swapper/021:55:110
1675199180,13cyclictest0-21swapper/023:57:040
16754991714,2cyclictest5401-21kworker/u8:121:45:053
1675499170,15cyclictest0-21swapper/323:50:153
16753991714,2cyclictest9993-21kworker/u8:122:39:042
16753991714,2cyclictest0-21swapper/223:20:112
1675399171,14cyclictest0-21swapper/220:00:152
16752991713,2cyclictest1684-21fschecks_time19:55:131
81822161,3sleep00-21swapper/022:30:120
1675499161,13cyclictest18311-21python20:41:033
16753991613,2cyclictest400-21kworker/u8:222:10:052
16753991613,2cyclictest23704-21kworker/u8:222:57:052
16753991613,2cyclictest17304-21kworker/u8:021:34:042
16753991613,2cyclictest1255-21kworker/u8:019:19:052
1675399161,13cyclictest21033-21apt-get19:20:102
16753991611,3cyclictest0-21swapper/200:07:272
16752991613,2cyclictest21421-21kworker/u8:100:03:051
16752991612,3cyclictest5401-21kworker/u8:121:33:041
1675299160,2cyclictest0-21swapper/123:18:321
182742151,3sleep118373-21iostat_ios22:40:151
1675499151,3cyclictest19677-21apt-get21:35:113
16754991512,2cyclictest21421-21kworker/u8:123:58:063
1675499150,3cyclictest11615-21aten2.4_r3power20:25:123
1675499150,13cyclictest10398-21awk23:05:183
1675499150,13cyclictest0-21swapper/322:14:253
1675399151,3cyclictest19772-21ssh23:49:572
16753991512,2cyclictest8293-21kworker/u8:120:23:052
16753991512,2cyclictest4719-21kworker/u8:020:14:052
16753991512,2cyclictest30749-21kworker/u8:022:22:052
16753991512,2cyclictest29883-21kworker/u8:000:20:052
16753991512,2cyclictest2520-21kworker/u8:220:19:042
16753991512,2cyclictest21421-21kworker/u8:123:58:022
1675399151,12cyclictest15311-21ssh00:18:222
16753991511,2cyclictest0-21swapper/220:30:132
16752991512,2cyclictest0-21swapper/122:12:111
16752991512,2cyclictest0-21swapper/121:38:411
16752991512,2cyclictest0-21swapper/100:25:411
16752991510,2cyclictest0-21swapper/123:39:591
1675299150,3cyclictest12784-21pzem_power22:00:401
1675299150,3cyclictest12784-21pzem_power22:00:391
1675299150,2cyclictest0-21swapper/121:13:311
1675299150,14cyclictest0-21swapper/121:53:511
1675299150,14cyclictest0-21swapper/119:15:111
1675299150,13cyclictest0-21swapper/123:13:511
1675299150,13cyclictest0-21swapper/122:59:111
1675299150,13cyclictest0-21swapper/122:18:501
1675299150,13cyclictest0-21swapper/121:26:511
1675199151,12cyclictest2261-21ssh00:38:460
1675199151,12cyclictest2261-21ssh00:38:460
1675199150,2cyclictest0-21swapper/023:10:160
1675499141,3cyclictest3728-21runrttasks22:42:513
1675499141,3cyclictest17351-21ssh21:31:533
1675499140,3cyclictest4686-21ssh23:33:583
1675499140,2cyclictest0-21swapper/323:03:553
1675499140,2cyclictest0-21swapper/300:03:043
1675499140,12cyclictest0-21swapper/323:25:103
1675499140,12cyclictest0-21swapper/322:00:113
1675499140,12cyclictest0-21swapper/322:00:103
16753991411,2cyclictest9993-21kworker/u8:122:44:022
16753991411,2cyclictest8293-21kworker/u8:120:38:052
16753991411,2cyclictest5401-21kworker/u8:121:44:012
16753991411,2cyclictest30749-21kworker/u8:022:30:052
16753991411,2cyclictest29883-21kworker/u8:000:28:062
16753991411,2cyclictest26464-21kworker/u8:119:48:022
16753991411,2cyclictest23188-21kworker/u8:021:04:052
16753991411,2cyclictest18859-21kworker/u8:122:15:042
16753991411,2cyclictest13532-21kworker/u8:020:45:052
16753991411,2cyclictest0-21swapper/223:50:122
16753991411,2cyclictest0-21swapper/223:40:022
16753991410,2cyclictest29806-21rm22:51:572
1675399140,12cyclictest9275-21kworker/2:123:25:002
1675399140,12cyclictest30462-21seq21:11:402
1675399140,12cyclictest1724-21ssh00:37:572
1675399140,12cyclictest1724-21ssh00:37:562
1675399140,12cyclictest0-21swapper/219:35:142
16752991411,2cyclictest0-21swapper/123:53:001
16752991411,2cyclictest0-21swapper/123:01:321
16752991411,2cyclictest0-21swapper/122:23:411
16752991411,2cyclictest0-21swapper/121:40:201
16752991411,2cyclictest0-21swapper/100:38:011
16752991411,2cyclictest0-21swapper/100:38:001
1675299140,13cyclictest0-21swapper/123:46:511
1675299140,13cyclictest0-21swapper/123:05:401
1675299140,13cyclictest0-21swapper/121:20:111
1675299140,13cyclictest0-21swapper/121:15:101
1675299140,13cyclictest0-21swapper/120:40:401
1675299140,13cyclictest0-21swapper/100:30:201
1675299140,12cyclictest0-21swapper/123:26:141
1675299140,12cyclictest0-21swapper/123:20:451
1675299140,12cyclictest0-21swapper/122:50:111
1675299140,12cyclictest0-21swapper/121:58:421
1675299140,12cyclictest0-21swapper/120:35:111
1675299140,12cyclictest0-21swapper/100:24:511
16751991411,2cyclictest0-21swapper/021:16:260
1675199140,13cyclictest0-21swapper/023:03:160
1675199140,12cyclictest0-21swapper/019:35:100
43482130,2sleep00-21swapper/022:25:270
314312131,3sleep30-21swapper/322:20:183
207772130,2sleep20-21swapper/223:16:072
1675499138,3cyclictest3728-21runrttasks23:45:183
1675499131,10cyclictest3062-21ssh21:50:463
16754991310,2cyclictest5401-21kworker/u8:121:42:013
16754991310,2cyclictest381ktimersoftd/322:30:353
16754991310,2cyclictest0-21swapper/322:45:193
16754991310,2cyclictest0-21swapper/322:07:593
16754991310,2cyclictest0-21swapper/321:27:283
16754991310,2cyclictest0-21swapper/320:10:153
16754991310,2cyclictest0-21swapper/300:25:133
16754991310,2cyclictest0-21swapper/300:07:563
1675499130,2cyclictest0-21swapper/322:36:003
1675499130,2cyclictest0-21swapper/322:28:153
1675499130,2cyclictest0-21swapper/300:20:173
1675499130,12cyclictest0-21swapper/321:15:103
1675399138,3cyclictest17491-21fschecks_time19:10:132
1675399134,7cyclictest4562-21gdm-simple-gree20:56:592
16753991310,2cyclictest7576-21ssh23:02:392
16753991310,2cyclictest703-21kworker/u8:019:55:052
16753991310,2cyclictest5401-21kworker/u8:121:37:052
16753991310,2cyclictest5401-21kworker/u8:121:26:052
16753991310,2cyclictest400-21kworker/u8:221:50:062
16753991310,2cyclictest32145-21kworker/u8:123:07:052
16753991310,2cyclictest26464-21kworker/u8:120:05:052
16753991310,2cyclictest23188-21kworker/u8:021:09:042
1675399130,2cyclictest0-21swapper/222:00:162
1675399130,2cyclictest0-21swapper/222:00:152
1675399130,2cyclictest0-21swapper/221:55:562
1675399130,11cyclictest0-21swapper/222:07:442
16752991310,2cyclictest0-21swapper/122:25:201
16752991310,2cyclictest0-21swapper/121:45:301
16752991310,2cyclictest0-21swapper/119:11:021
16752991310,2cyclictest0-21swapper/100:15:211
16752991310,2cyclictest0-21swapper/100:11:231
16752991310,2cyclictest0-21swapper/100:06:011
1675299130,2cyclictest0-21swapper/123:42:511
1675299130,2cyclictest0-21swapper/120:55:151
1675299130,2cyclictest0-21swapper/119:31:011
1675299130,12cyclictest0-21swapper/123:32:421
1675299130,12cyclictest0-21swapper/122:30:281
1675299130,12cyclictest0-21swapper/120:10:151
1675299130,11cyclictest0-21swapper/122:36:081
16751991310,2cyclictest0-21swapper/023:05:170
16751991310,2cyclictest0-21swapper/022:36:320
16751991310,2cyclictest0-21swapper/021:20:140
16751991310,2cyclictest0-21swapper/019:15:140
16751991310,2cyclictest0-21swapper/000:05:000
1675199130,12cyclictest23704-21kworker/u8:222:46:050
1675199130,12cyclictest0-21swapper/021:41:360
1675199130,12cyclictest0-21swapper/000:01:030
1675199130,11cyclictest3649-21snmpd21:11:140
1675199130,11cyclictest0-21swapper/023:38:060
1675199130,11cyclictest0-21swapper/022:57:160
1675199130,11cyclictest0-21swapper/021:46:130
1675499129,2cyclictest6716-21ps23:35:173
1675499129,2cyclictest0-21swapper/323:20:143
1675499129,2cyclictest0-21swapper/322:57:243
1675499129,2cyclictest0-21swapper/322:54:353
1675499129,2cyclictest0-21swapper/300:16:513
1675499120,2cyclictest0-21swapper/323:11:343
1675499120,2cyclictest0-21swapper/322:18:593
1675499120,2cyclictest0-21swapper/320:55:153
1675499120,2cyclictest0-21swapper/319:31:003
1675499120,11cyclictest0-21swapper/323:15:553
1675499120,11cyclictest0-21swapper/321:57:023
1675499120,11cyclictest0-21swapper/321:23:373
1675499120,11cyclictest0-21swapper/319:40:143
1675499120,11cyclictest0-21swapper/300:37:323
1675499120,11cyclictest0-21swapper/300:37:313
1675499120,11cyclictest0-21swapper/300:11:023
1675399129,2cyclictest13532-21kworker/u8:020:42:042
1675399129,2cyclictest0-21swapper/221:15:142
1675399129,2cyclictest0-21swapper/220:26:032
1675399129,2cyclictest0-21swapper/200:31:182
1675399120,2cyclictest0-21swapper/222:48:072
1675399120,2cyclictest0-21swapper/219:30:592
1675399120,1cyclictest0-21swapper/221:23:162
1675399120,11cyclictest0-21swapper/223:36:482
1675399120,11cyclictest0-21swapper/221:45:302
1675399120,11cyclictest0-21swapper/200:10:272
1675299129,2cyclictest1255-21kworker/u8:019:20:051
1675299129,2cyclictest0-21swapper/123:55:281
1675299120,2cyclictest0-21swapper/120:46:021
1675299120,11cyclictest0-21swapper/122:46:451
1675199129,2cyclictest26264-21df_abs22:15:120
1675199129,2cyclictest16494-21ssh23:45:280
1675199129,2cyclictest0-21swapper/022:50:160
1675199129,2cyclictest0-21swapper/022:00:410
1675199129,2cyclictest0-21swapper/022:00:410
1675199129,2cyclictest0-21swapper/021:30:020
1675199129,2cyclictest0-21swapper/021:25:080
1675199129,2cyclictest0-21swapper/000:26:490
1675199129,2cyclictest0-21swapper/000:10:470
1675199120,2cyclictest0-21swapper/023:15:100
1675199120,2cyclictest0-21swapper/019:30:130
1675199120,2cyclictest0-21swapper/000:33:050
1675199120,11cyclictest0-21swapper/023:30:530
1675199120,11cyclictest0-21swapper/023:20:140
1675199120,11cyclictest0-21swapper/022:14:160
1675199120,11cyclictest0-21swapper/021:50:110
1675199120,11cyclictest0-21swapper/020:20:120
1675199120,11cyclictest0-21swapper/019:45:110
1675199120,11cyclictest0-21swapper/000:20:230
1675199120,10cyclictest18728-21ssh22:06:480
3582110,2sleep00-21swapper/022:21:190
1675499118,2cyclictest0-21swapper/320:20:113
1675499118,2cyclictest0-21swapper/320:15:143
1675499118,2cyclictest0-21swapper/300:31:023
1675499111,2cyclictest0-21swapper/321:10:563
1675399112,7cyclictest0-21swapper/219:42:022
1675399110,2cyclictest0-21swapper/219:27:042
1675399110,1cyclictest0-21swapper/220:50:172
1675399110,10cyclictest0-21swapper/222:25:092
1675299110,9cyclictest0-21swapper/120:30:141
1675299110,9cyclictest0-21swapper/120:25:131
1675299110,9cyclictest0-21swapper/120:05:111
1675199118,2cyclictest9891-21date20:19:590
1675199118,2cyclictest0-21swapper/020:45:170
1675199118,2cyclictest0-21swapper/019:20:110
1675199118,2cyclictest0-21swapper/000:16:070
1675199110,8cyclictest0-21swapper/020:00:020
1675199110,7cyclictest0-21swapper/020:51:100
1675199110,2cyclictest27799-21diskmemload22:43:380
1675199110,10cyclictest703-21kworker/u8:019:57:050
1675199110,10cyclictest27799-21diskmemload23:41:040
1675199110,10cyclictest1255-21kworker/u8:019:27:040
121392110,1sleep00-21swapper/020:25:170
6162100,2sleep20-21swapper/219:50:572
1675499107,2cyclictest1255-21kworker/u8:019:16:053
1675499107,2cyclictest0-21swapper/320:05:123
1675499100,2cyclictest0-21swapper/320:01:103
1675299107,2cyclictest9947-21apt-get20:20:111
1675299107,2cyclictest26366-21apt-get19:35:101
1675299107,2cyclictest2520-21kworker/u8:220:03:041
1675299107,2cyclictest0-21swapper/119:47:231
1675299100,8cyclictest8309-21munin-node1
1675299100,8cyclictest23186-21perl19:25:141
1675199107,2cyclictest0-21swapper/020:55:130
1675199107,2cyclictest0-21swapper/020:30:190
1675199106,2cyclictest0-21swapper/023:50:110
1675199102,7cyclictest0-21swapper/021:00:590
1675199101,7cyclictest7908-21sshd20:12:450
1675199100,9cyclictest4719-21kworker/u8:020:06:050
27423290,2sleep30-21swapper/321:05:343
167549996,2cyclictest8293-21kworker/u8:120:52:043
167549996,2cyclictest23188-21kworker/u8:021:02:013
167549996,2cyclictest1255-21kworker/u8:019:10:043
167549996,2cyclictest0-21swapper/320:45:103
167549994,3cyclictest950-21cron19:55:003
167549994,3cyclictest13975-21grep20:30:153
167549991,3cyclictest0-21swapper/319:45:163
167549990,2cyclictest0-21swapper/319:20:053
167529996,2cyclictest0-21swapper/119:50:121
167529990,8cyclictest0-21swapper/121:05:111
167529990,8cyclictest0-21swapper/120:50:101
167529990,8cyclictest0-21swapper/119:40:141
167529990,2cyclictest0-21swapper/121:00:141
167519996,2cyclictest0-21swapper/020:40:110
167519996,2cyclictest0-21swapper/020:35:120
167519994,3cyclictest28660-21interrupts19:40:140
167519994,3cyclictest18111-21mailstats19:11:000
167519990,6cyclictest0-21swapper/021:06:580
22644280,6sleep30-21swapper/319:25:023
167549985,2cyclictest17062-21kworker/u8:219:35:043
167549983,3cyclictest1691-21grep19:55:133
167519984,2cyclictest32218-21cpu19:50:110
16673280,2sleep30-21swapper/320:37:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional