You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 09:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sat Aug 29, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
300532115104,6sleep10-21swapper/119:07:401
30192211086,19sleep00-21swapper/019:09:270
29460210387,11sleep30-21swapper/319:05:273
3011229979,15sleep20-21swapper/219:08:252
201932840,0sleep30-21swapper/322:58:373
161672830,0sleep00-21swapper/000:36:010
8802720,0sleep30-21swapper/322:05:063
317932720,0sleep00-21swapper/022:02:570
217922710,0sleep00-21swapper/020:10:000
30260994022,16cyclictest0-21swapper/023:25:110
3026299221,19cyclictest0-21swapper/221:45:112
30261992219,2cyclictest22607-21kworker/u8:023:31:041
30260992219,2cyclictest9869-21kworker/u8:122:42:040
3026099221,19cyclictest0-21swapper/023:55:130
30263992118,2cyclictest24917-21kworker/u8:022:35:043
30262992117,2cyclictest0-21swapper/221:00:102
30260992118,2cyclictest24917-21kworker/u8:022:30:040
30260992118,2cyclictest22636-21kworker/u8:100:22:040
3026099210,16cyclictest0-21swapper/023:42:040
189982210,1sleep118997-21irqstats00:05:161
30263992017,2cyclictest7535-21kworker/u8:121:38:043
30263992017,2cyclictest18569-21kworker/u8:021:58:013
30260992017,2cyclictest15640-21kworker/u8:222:27:040
216152200,1sleep229-21rcuc/221:18:142
30263991916,2cyclictest28557-21kworker/u8:223:25:043
30263991916,2cyclictest15640-21kworker/u8:222:22:043
3026299190,2cyclictest0-21swapper/220:00:112
30261991916,2cyclictest18569-21kworker/u8:021:57:051
30261991916,2cyclictest15660-21kworker/u8:123:28:041
30260991916,2cyclictest28557-21kworker/u8:223:22:050
30260991916,2cyclictest22607-21kworker/u8:023:33:050
30260991916,2cyclictest22605-21kworker/u8:021:20:050
30260991916,2cyclictest18569-21kworker/u8:021:58:050
30261991815,2cyclictest7535-21kworker/u8:121:37:041
3026199181,2cyclictest0-21swapper/122:35:041
3026099182,14cyclictest0-21swapper/019:55:110
30260991815,2cyclictest9869-21kworker/u8:122:45:040
30260991815,2cyclictest7446-21kworker/u8:121:26:040
30260991815,2cyclictest6264-21kworker/u8:200:18:050
30263991714,2cyclictest6264-21kworker/u8:200:27:043
30261991714,2cyclictest7446-21kworker/u8:121:10:041
30261991714,2cyclictest6264-21kworker/u8:200:30:041
30260991714,2cyclictest21396-21kworker/u8:223:39:040
3026099171,2cyclictest13253-21diskmemload22:35:040
30263991613,2cyclictest7446-21kworker/u8:121:25:043
30263991613,2cyclictest7446-21kworker/u8:121:21:043
30263991613,2cyclictest6264-21kworker/u8:223:53:043
30263991613,2cyclictest26957-21kworker/u8:023:47:043
30263991613,2cyclictest22636-21kworker/u8:100:15:043
30263991613,2cyclictest13689-21kworker/u8:221:18:063
3026299161,13cyclictest32480-21rm23:45:142
3026299160,14cyclictest22645-21ssh21:53:242
3026299160,13cyclictest0-21swapper/220:20:132
30261991613,2cyclictest7535-21kworker/u8:121:52:041
30261991613,2cyclictest22636-21kworker/u8:100:13:041
3026199160,2cyclictest0-21swapper/100:18:011
3026199160,14cyclictest0-21swapper/121:23:041
30260991613,2cyclictest30166-21kworker/u8:122:07:040
30260991613,2cyclictest26957-21kworker/u8:023:49:040
3026099161,13cyclictest0-21swapper/023:20:000
3026099161,13cyclictest0-21swapper/023:20:000
30260991611,3cyclictest0-21swapper/019:15:140
30263991512,2cyclictest9869-21kworker/u8:123:02:043
30263991512,2cyclictest9869-21kworker/u8:122:18:043
30263991512,2cyclictest24049-21kworker/u8:222:12:043
30263991512,2cyclictest1461-21kworker/u8:021:42:053
30263991512,2cyclictest11226-21kworker/u8:000:09:043
3026399150,13cyclictest0-21swapper/320:35:113
3026299151,12cyclictest8677-21ssh00:28:452
3026299151,12cyclictest11945-21ssh22:15:382
30262991510,3cyclictest23984-21munin-node2
3026299150,13cyclictest12365-21ssh00:32:052
30261991512,2cyclictest7446-21kworker/u8:121:28:051
30261991512,2cyclictest30541-21kworker/u8:119:54:041
30261991512,2cyclictest28557-21kworker/u8:223:13:041
30261991512,2cyclictest24049-21kworker/u8:222:11:041
30261991512,2cyclictest12484-21kworker/u8:222:58:041
3026199151,12cyclictest795-21python19:16:021
3026199150,2cyclictest13253-21diskmemload23:09:041
3026199150,2cyclictest0-21swapper/100:27:041
3026199150,14cyclictest0-21swapper/100:24:591
30260991512,2cyclictest7535-21kworker/u8:121:51:040
30260991512,2cyclictest1461-21kworker/u8:021:33:040
30260991512,2cyclictest12987-21kworker/u8:221:48:040
3026099150,2cyclictest0-21swapper/023:09:040
3026099150,2cyclictest0-21swapper/000:27:040
30263991411,2cyclictest6264-21kworker/u8:223:59:043
30263991411,2cyclictest28557-21kworker/u8:223:08:043
30263991411,2cyclictest22636-21kworker/u8:100:12:043
30263991411,2cyclictest1461-21kworker/u8:021:31:043
3026399140,2cyclictest0-21swapper/323:31:043
3026399140,12cyclictest3806-21perl23:15:143
3026399140,12cyclictest3806-21perl23:15:143
3026399140,12cyclictest0-21swapper/319:40:113
3026299149,3cyclictest31575-21iostat_ios23:10:152
3026299149,3cyclictest26911-21rm21:24:072
3026299149,3cyclictest0-21swapper/222:59:132
3026299149,3cyclictest0-21swapper/200:35:132
3026299142,6cyclictest0-21swapper/221:05:012
3026299141,2cyclictest3728-21runrttasks23:15:582
3026299141,2cyclictest3728-21runrttasks23:15:582
3026299141,2cyclictest14215-21ssh22:51:382
30262991411,2cyclictest13253-21diskmemload21:30:142
3026299140,2cyclictest6696-21ssh22:44:542
3026299140,12cyclictest9649-21ssh23:55:152
3026299140,12cyclictest0-21swapper/223:08:072
3026299140,12cyclictest0-21swapper/200:00:162
3026199143,9cyclictest0-21swapper/123:45:101
3026199141,2cyclictest207150irq/24-eth123:18:091
3026199141,2cyclictest207150irq/24-eth123:18:091
30261991411,2cyclictest6264-21kworker/u8:200:03:041
30261991411,2cyclictest31720-21kworker/u8:020:58:041
3026199140,2cyclictest0-21swapper/122:18:191
3026199140,2cyclictest0-21swapper/121:18:051
3026199140,13cyclictest13253-21diskmemload22:28:491
3026199140,12cyclictest0-21swapper/122:20:401
30260991411,2cyclictest6264-21kworker/u8:200:05:040
30260991411,2cyclictest30541-21kworker/u8:119:13:050
3026099140,2cyclictest0-21swapper/022:19:040
3026099140,12cyclictest8371-21ssh22:11:520
3026099140,12cyclictest0-21swapper/021:10:170
101872140,2sleep30-21swapper/322:47:553
30263991310,2cyclictest6916-21pzem_voltage19:30:533
30263991310,2cyclictest6264-21kworker/u8:200:04:043
30263991310,2cyclictest30541-21kworker/u8:119:52:053
30263991310,2cyclictest30541-21kworker/u8:119:14:053
30263991310,2cyclictest28557-21kworker/u8:223:20:163
30263991310,2cyclictest28557-21kworker/u8:223:10:043
30263991310,2cyclictest22636-21kworker/u8:100:36:043
30263991310,2cyclictest21396-21kworker/u8:223:36:043
30263991310,2cyclictest18569-21kworker/u8:022:00:043
30263991310,2cyclictest18569-21kworker/u8:021:50:043
3026399130,1cyclictest0-21swapper/320:26:023
3026299132,7cyclictest0-21swapper/221:10:002
3026299132,6cyclictest0-21swapper/222:10:002
30262991310,2cyclictest18106-21ssh22:22:072
30262991310,2cyclictest13253-21diskmemload23:04:582
30262991310,2cyclictest0-21swapper/223:43:152
30262991310,2cyclictest0-21swapper/222:46:022
30262991310,2cyclictest0-21swapper/221:25:152
30262991310,2cyclictest0-21swapper/220:50:172
30262991310,2cyclictest0-21swapper/200:15:132
30262991310,2cyclictest0-21swapper/200:13:222
3026299130,2cyclictest10887-21ssh21:40:272
3026299130,2cyclictest0-21swapper/223:34:372
3026299130,2cyclictest0-21swapper/222:28:012
3026299130,12cyclictest1525-21ssh00:20:512
3026299130,12cyclictest13253-21diskmemload23:28:522
3026299130,12cyclictest0-21swapper/223:51:072
3026299130,12cyclictest0-21swapper/223:24:252
3026299130,12cyclictest0-21swapper/222:32:422
3026299130,12cyclictest0-21swapper/222:11:142
3026299130,12cyclictest0-21swapper/222:01:402
3026299130,12cyclictest0-21swapper/220:25:162
3026299130,11cyclictest0-21swapper/220:45:102
3026299130,11cyclictest0-21swapper/220:10:162
3026199131,3cyclictest12278-21grep22:50:141
3026199131,10cyclictest0-21swapper/120:20:141
30261991310,2cyclictest21068-21kworker/u8:020:06:051
30261991310,2cyclictest18031-21kworker/u8:220:19:041
30261991310,2cyclictest18031-21kworker/u8:220:03:041
30261991310,2cyclictest1746-21kworker/u8:220:47:041
30261991310,2cyclictest0-21swapper/122:47:411
30261991310,2cyclictest0-21swapper/121:45:231
30261991310,2cyclictest0-21swapper/121:30:141
30261991310,2cyclictest0-21swapper/100:35:441
3026199130,2cyclictest0-21swapper/123:55:401
3026199130,12cyclictest0-21swapper/123:50:111
3026199130,12cyclictest0-21swapper/123:20:131
3026199130,12cyclictest0-21swapper/123:02:291
3026199130,12cyclictest0-21swapper/122:30:411
3026199130,12cyclictest0-21swapper/122:00:171
3026199130,11cyclictest0-21swapper/121:40:051
3026199130,11cyclictest0-21swapper/119:25:401
30260991310,2cyclictest31720-21kworker/u8:020:34:050
30260991310,2cyclictest30541-21kworker/u8:119:30:040
30260991310,2cyclictest0-21swapper/022:50:170
3026099130,2cyclictest0-21swapper/022:24:550
3026099130,12cyclictest21355-21ssh23:00:060
283762130,2sleep10-21swapper/123:40:401
19702130,2sleep00-21swapper/023:13:370
3026399129,2cyclictest30541-21kworker/u8:119:26:053
3026399129,2cyclictest15640-21kworker/u8:222:25:043
3026399129,2cyclictest0-21swapper/323:44:123
3026399129,2cyclictest0-21swapper/322:31:043
3026399120,2cyclictest0-21swapper/300:20:133
3026399120,1cyclictest0-21swapper/320:55:213
3026399120,11cyclictest0-21swapper/322:50:143
3026399120,11cyclictest0-21swapper/320:11:003
3026399120,10cyclictest0-21swapper/321:12:583
3026299129,2cyclictest0-21swapper/219:54:182
3026299129,2cyclictest0-21swapper/219:35:072
3026299129,2cyclictest0-21swapper/219:30:162
3026299129,2cyclictest0-21swapper/200:05:392
3026299122,6cyclictest0-21swapper/219:15:002
3026299122,5cyclictest0-21swapper/221:00:002
3026299120,2cyclictest0-21swapper/222:35:242
3026299120,2cyclictest0-21swapper/221:55:482
3026299120,2cyclictest0-21swapper/220:05:382
3026299120,1cyclictest0-21swapper/220:43:162
3026299120,11cyclictest0-21swapper/221:38:182
3026299120,11cyclictest0-21swapper/219:56:012
3026299120,11cyclictest0-21swapper/219:40:112
3026199129,2cyclictest0-21swapper/120:50:111
3026199121,9cyclictest6101-21expr19:30:131
3026199121,3cyclictest0-21swapper/119:40:101
3026199121,3cyclictest0-21swapper/119:20:131
3026199120,2cyclictest0-21swapper/122:40:161
3026199120,2cyclictest0-21swapper/122:05:371
3026199120,2cyclictest0-21swapper/119:45:181
3026199120,2cyclictest0-21swapper/119:45:171
3026199120,11cyclictest0-21swapper/121:01:031
3026199120,11cyclictest0-21swapper/120:35:331
3026199120,10cyclictest0-21swapper/123:35:061
3026099129,2cyclictest23461-21kworker/u8:120:36:040
3026099129,2cyclictest18031-21kworker/u8:220:18:040
3026099129,2cyclictest1746-21kworker/u8:220:44:040
3026099129,2cyclictest0-21swapper/000:31:020
3026099120,2cyclictest0-21swapper/022:55:180
3026099120,2cyclictest0-21swapper/021:00:150
3026099120,2cyclictest0-21swapper/019:45:130
3026099120,2cyclictest0-21swapper/019:45:130
3026099120,1cyclictest0-21swapper/021:18:050
3026099120,11cyclictest15331-21ssh00:00:580
3026099120,11cyclictest0-21swapper/021:40:100
3026099120,11cyclictest0-21swapper/021:35:160
3026099120,11cyclictest0-21swapper/019:40:110
3026099120,11cyclictest0-21swapper/000:14:010
3026099120,10cyclictest0-21swapper/023:50:050
3026099120,10cyclictest0-21swapper/020:45:130
109762120,9sleep33649-21snmpd21:01:373
3026399118,2cyclictest1882-21copy22:40:033
3026399118,2cyclictest12987-21kworker/u8:221:45:043
3026399117,3cyclictest18031-21kworker/u8:220:01:043
3026399110,3cyclictest11919-21munin-node3
3026399110,3cyclictest11919-21munin-node3
3026399110,10cyclictest0-21swapper/320:15:183
3026399110,10cyclictest0-21swapper/300:33:363
3026299118,2cyclictest0-21swapper/220:15:132
3026299112,7cyclictest0-21swapper/220:33:582
3026299111,6cyclictest0-21swapper/220:35:102
3026199118,2cyclictest0-21swapper/119:35:491
3026199110,9cyclictest1617-21apt-get20:40:111
3026199110,9cyclictest0-21swapper/119:10:111
3026099118,2cyclictest30541-21kworker/u8:119:23:040
3026099118,2cyclictest18031-21kworker/u8:220:13:040
3026099116,3cyclictest27453-21sed20:21:030
3026099110,9cyclictest0-21swapper/020:55:150
3026099110,6cyclictest0-21swapper/021:05:040
3026399107,2cyclictest30541-21kworker/u8:119:39:043
3026399107,2cyclictest18031-21kworker/u8:220:32:043
3026399107,2cyclictest1648-21kworker/u8:019:20:043
3026399107,2cyclictest0-21swapper/320:40:123
3026399105,3cyclictest7088-21sendmail-mta20:53:333
3026399105,3cyclictest3811-21cut20:45:123
3026399105,3cyclictest27666-21sendmail-mta20:24:283
3026399100,1cyclictest0-21swapper/320:05:013
3026299107,2cyclictest0-21swapper/219:23:432
3026299107,2cyclictest0-21swapper/219:15:502
3026199107,2cyclictest18031-21kworker/u8:220:10:041
3026199101,3cyclictest0-21swapper/121:05:281
3026199100,8cyclictest30070-21aten2.4_r3power20:30:111
3026199100,3cyclictest28025-21munin-node1
3026199100,3cyclictest15936-21munin-node1
3026099107,2cyclictest31720-21kworker/u8:020:52:040
3026099100,9cyclictest0-21swapper/019:54:400
3026099100,3cyclictest0-21swapper/019:25:170
302639996,2cyclictest30541-21kworker/u8:119:55:043
302639996,2cyclictest0-21swapper/321:06:003
302629994,3cyclictest11923-21apt-get19:45:102
302629994,3cyclictest11923-21apt-get19:45:102
302629991,6cyclictest0-21swapper/219:25:112
302609994,3cyclictest2850-21rsyslogd20:25:170
302609994,3cyclictest18024-21aten2.4-expect20:00:110
302609991,3cyclictest0-21swapper/019:40:000
302639985,2cyclictest0-21swapper/319:15:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional