You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 09:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue May 26, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22053211897,16sleep00-21swapper/019:06:310
22106211594,16sleep20-21swapper/219:07:132
215502115104,6sleep30-21swapper/319:05:263
222572112101,6sleep10-21swapper/119:09:091
53372730,0sleep30-21swapper/323:57:123
320652720,0sleep30-21swapper/322:10:293
287592710,1sleep2301ktimersoftd/223:48:212
84002700,1sleep08397-21sh22:53:430
256262650,0sleep10-21swapper/122:04:501
103312280,1sleep010335-21latency22:55:150
26552230,1sleep1221ktimersoftd/122:14:361
85162220,1sleep0101ktimersoftd/019:56:020
2235199220,20cyclictest0-21swapper/020:10:120
22354992117,2cyclictest0-21swapper/322:25:113
2235299210,19cyclictest0-21swapper/123:45:121
2235499200,2cyclictest0-21swapper/322:55:113
2235399200,18cyclictest0-21swapper/222:20:122
2235299200,2cyclictest0-21swapper/122:55:111
2235299200,18cyclictest0-21swapper/121:35:121
22354991912,5cyclictest20511-21ssh21:25:163
2235499180,6cyclictest0-21swapper/319:59:593
2235499180,16cyclictest0-21swapper/323:45:123
22352991815,2cyclictest5011-21kworker/u8:200:12:051
22352991815,2cyclictest32202-21kworker/u8:023:57:041
22354991611,3cyclictest0-21swapper/322:10:013
2235299161,3cyclictest0-21swapper/120:30:121
2235299161,13cyclictest0-21swapper/123:17:561
2235199161,13cyclictest3728-21runrttasks22:28:020
22351991611,3cyclictest0-21swapper/019:25:150
196202160,1sleep00-21swapper/023:05:140
295342150,3sleep029544-21ssh23:49:350
2235499151,12cyclictest7140-21df21:45:133
2235499151,12cyclictest0-21swapper/322:35:003
2235299151,3cyclictest9384-21ssh22:20:271
2235299151,3cyclictest6379-21ssh21:10:211
22352991512,2cyclictest0-21swapper/123:11:211
2235299151,12cyclictest4052-21ntp_states19:45:171
2235299151,12cyclictest25417-21apt-get20:40:101
22352991510,3cyclictest26650-21hddtemp_smartct22:05:131
2235299150,13cyclictest0-21swapper/123:52:561
22351991510,3cyclictest26475-21ssh21:31:030
22351991510,3cyclictest0-21swapper/021:47:550
2235199150,3cyclictest0-21swapper/023:20:220
2235199150,13cyclictest3095-21perl23:55:150
2235499142,5cyclictest0-21swapper/319:49:583
2235499141,3cyclictest19847-21ssh00:12:223
2235499141,11cyclictest23804-21ssh23:43:073
22354991410,2cyclictest0-21swapper/300:17:123
2235499140,12cyclictest0-21swapper/300:06:213
2235399149,3cyclictest31912-21munin-run22:44:592
22353991411,2cyclictest23392-21apt-get20:35:122
22353991411,2cyclictest0-21swapper/221:55:312
2235399140,2cyclictest3111-21apt-get19:45:112
2235399140,12cyclictest0-21swapper/221:21:032
2235399140,12cyclictest0-21swapper/221:00:112
2235299142,7cyclictest0-21swapper/122:40:001
22352991411,2cyclictest0-21swapper/122:51:051
22352991411,2cyclictest0-21swapper/121:46:011
2235299140,2cyclictest4974-21diskmemload21:43:401
2235299140,13cyclictest0-21swapper/123:29:401
2235299140,13cyclictest0-21swapper/121:51:011
2235299140,12cyclictest0-21swapper/123:05:481
2235299140,12cyclictest0-21swapper/121:25:031
2235299140,12cyclictest0-21swapper/100:20:161
2235199144,5cyclictest4974-21diskmemload22:02:050
2235199142,7cyclictest0-21swapper/022:15:010
2235199142,6cyclictest0-21swapper/020:00:000
2235199141,2cyclictest17883-21perl20:20:140
22351991411,2cyclictest25048-21ssh23:10:220
22351991411,2cyclictest0-21swapper/023:18:320
2235199141,11cyclictest0-21swapper/021:13:320
22351991410,2cyclictest10453-21ssh00:36:010
2235199140,2cyclictest32246-21apt-get22:45:120
2235199140,2cyclictest0-21swapper/020:45:120
22354991310,2cyclictest0-21swapper/323:28:223
22354991310,2cyclictest0-21swapper/322:47:033
22354991310,2cyclictest0-21swapper/322:40:523
22354991310,2cyclictest0-21swapper/322:15:113
22354991310,2cyclictest0-21swapper/321:55:013
22354991310,2cyclictest0-21swapper/321:54:503
2235499130,2cyclictest0-21swapper/322:36:323
2235499130,12cyclictest0-21swapper/319:50:123
2235499130,11cyclictest4974-21diskmemload00:33:193
2235499130,11cyclictest10609-21copy23:30:023
2235399139,2cyclictest0-21swapper/220:11:012
2235399133,6cyclictest0-21swapper/221:11:012
22353991310,2cyclictest0-21swapper/222:15:102
2235399130,12cyclictest0-21swapper/221:35:122
2235399130,11cyclictest29819-21diskstats20:50:152
2235299135,5cyclictest0-21swapper/120:58:591
2235299132,6cyclictest0-21swapper/120:05:001
22352991310,2cyclictest25813-21pzem_energy21:30:291
22352991310,2cyclictest0-21swapper/123:35:011
22352991310,2cyclictest0-21swapper/123:21:511
22352991310,2cyclictest0-21swapper/122:40:001
22352991310,2cyclictest0-21swapper/122:31:501
22352991310,2cyclictest0-21swapper/121:57:371
22352991310,2cyclictest0-21swapper/121:16:131
22352991310,2cyclictest0-21swapper/100:38:071
22352991310,2cyclictest0-21swapper/100:31:451
22352991310,2cyclictest0-21swapper/100:08:161
22352991310,2cyclictest0-21swapper/100:03:381
2235299130,2cyclictest4974-21diskmemload00:25:311
2235299130,2cyclictest161782sleep122:27:551
2235299130,2cyclictest0-21swapper/122:16:021
2235299130,2cyclictest0-21swapper/120:35:191
2235299130,2cyclictest0-21swapper/100:15:211
2235299130,12cyclictest4974-21diskmemload21:23:271
2235299130,12cyclictest0-21swapper/123:30:481
2235299130,12cyclictest0-21swapper/123:00:171
2235299130,12cyclictest0-21swapper/122:47:091
2235299130,12cyclictest0-21swapper/120:50:121
2235299130,12cyclictest0-21swapper/119:30:161
2235299130,11cyclictest0-21swapper/120:15:521
2235199138,3cyclictest20131-21ssh22:31:330
2235199138,3cyclictest0-21swapper/019:15:180
2235199132,8cyclictest0-21swapper/019:50:000
2235199132,6cyclictest0-21swapper/020:55:010
2235199132,6cyclictest0-21swapper/020:40:000
2235199132,6cyclictest0-21swapper/000:15:010
22351991311,1cyclictest0-21swapper/023:44:420
22351991310,2cyclictest20076-21ssh21:58:420
22351991310,2cyclictest0-21swapper/023:01:420
22351991310,2cyclictest0-21swapper/022:35:000
22351991310,2cyclictest0-21swapper/022:08:450
22351991310,2cyclictest0-21swapper/020:50:180
22351991310,2cyclictest0-21swapper/020:40:120
22351991310,2cyclictest0-21swapper/000:31:000
2235199130,2cyclictest0-21swapper/023:33:040
2235199130,2cyclictest0-21swapper/000:28:420
2235199130,12cyclictest0-21swapper/023:26:040
2235199130,11cyclictest28337-21ssh00:21:010
2235199130,11cyclictest0-21swapper/021:24:210
74612120,1sleep20-21swapper/200:00:122
324512120,2sleep20-21swapper/223:51:382
2235499129,2cyclictest0-21swapper/322:00:143
2235499129,2cyclictest0-21swapper/320:35:123
2235499122,7cyclictest30123-21ssh23:50:113
2235499120,6cyclictest0-21swapper/321:45:013
2235499120,2cyclictest2219-21ssh23:20:223
2235499120,11cyclictest32710-21ssh23:19:113
2235499120,11cyclictest0-21swapper/321:16:523
2235499120,11cyclictest0-21swapper/300:35:173
2235499120,11cyclictest0-21swapper/300:20:023
2235499120,11cyclictest0-21swapper/300:00:333
2235399129,2cyclictest0-21swapper/223:36:032
2235399129,2cyclictest0-21swapper/222:25:142
2235399129,2cyclictest0-21swapper/221:41:012
2235399129,2cyclictest0-21swapper/220:20:122
2235399129,2cyclictest0-21swapper/220:00:152
2235399122,6cyclictest13231-21ssh21:51:002
2235399121,8cyclictest4556-21metacity23:09:582
2235399120,2cyclictest0-21swapper/223:16:022
2235399120,2cyclictest0-21swapper/222:40:002
2235399120,11cyclictest0-21swapper/221:45:162
2235399120,11cyclictest0-21swapper/221:16:042
2235399120,11cyclictest0-21swapper/219:30:162
2235399120,10cyclictest0-21swapper/219:35:132
2235299129,2cyclictest0-21swapper/119:16:021
2235299129,2cyclictest0-21swapper/119:09:591
2235299122,6cyclictest0-21swapper/120:45:011
2235299121,9cyclictest31899-21munin-node1
2235299121,9cyclictest1073-21munin-node1
2235299121,9cyclictest0-21swapper/120:10:161
2235299121,3cyclictest0-21swapper/121:01:021
2235299120,2cyclictest0-21swapper/123:40:041
2235299120,11cyclictest0-21swapper/120:20:001
2235299120,11cyclictest0-21swapper/120:00:151
2235299120,11cyclictest0-21swapper/119:55:121
2235199129,2cyclictest4974-21diskmemload22:43:120
2235199129,2cyclictest0-21swapper/023:36:250
2235199129,2cyclictest0-21swapper/019:50:140
2235199122,7cyclictest0-21swapper/019:32:590
2235199122,6cyclictest9092-21ssh00:01:030
2235199121,3cyclictest24362-21munin-run19:15:000
2235199120,7cyclictest0-21swapper/019:45:000
2235199120,2cyclictest0-21swapper/023:50:130
2235199120,2cyclictest0-21swapper/000:08:030
2235199120,11cyclictest0-21swapper/022:21:180
2235199120,11cyclictest0-21swapper/021:50:440
2235199120,11cyclictest0-21swapper/021:37:120
2235199120,11cyclictest0-21swapper/021:00:200
2235199120,11cyclictest0-21swapper/000:11:420
137082120,2sleep00-21swapper/021:18:360
80832110,1sleep20-21swapper/222:53:142
6282110,1sleep30-21swapper/321:38:443
34412110,1sleep1221ktimersoftd/121:05:141
263322110,1sleep20-21swapper/200:20:002
260782110,1sleep20-21swapper/221:30:532
2235499118,2cyclictest0-21swapper/319:30:133
2235499117,2cyclictest0-21swapper/320:20:123
2235499117,2cyclictest0-21swapper/319:20:103
2235499116,3cyclictest0-21swapper/320:40:113
2235499111,6cyclictest0-21swapper/321:06:023
2235499111,6cyclictest0-21swapper/300:25:123
2235499111,5cyclictest0-21swapper/323:15:003
2235499110,9cyclictest15159-21munin-node3
2235499110,9cyclictest0-21swapper/321:34:073
2235499110,7cyclictest0-21swapper/323:08:593
2235499110,7cyclictest0-21swapper/320:14:543
2235499110,3cyclictest20499-21munin-node3
2235399118,2cyclictest0-21swapper/223:21:452
2235399118,2cyclictest0-21swapper/219:15:182
2235399113,6cyclictest0-21swapper/220:26:042
2235399112,6cyclictest0-21swapper/222:46:362
2235399112,6cyclictest0-21swapper/219:52:592
2235399110,2cyclictest0-21swapper/220:45:132
2235399110,2cyclictest0-21swapper/220:05:152
2235399110,10cyclictest0-21swapper/223:41:312
2235399110,10cyclictest0-21swapper/220:40:122
2235399110,10cyclictest0-21swapper/200:20:172
2235299118,2cyclictest0-21swapper/119:20:181
2235299110,9cyclictest0-21swapper/119:50:111
2235199116,3cyclictest0-21swapper/021:25:060
2235199112,6cyclictest0-21swapper/019:37:590
2235199110,2cyclictest0-21swapper/022:16:290
2235199110,10cyclictest0-21swapper/021:41:510
138822110,1sleep20-21swapper/222:59:522
68172100,2sleep20-21swapper/223:59:312
4872100,2sleep20-21swapper/200:25:542
2235499107,2cyclictest5709-21ssh21:10:133
2235499105,3cyclictest26019-21grep19:16:043
2235499104,4cyclictest28538-21tr19:25:143
2235499100,9cyclictest4974-21diskmemload23:35:393
2235499100,2cyclictest0-21swapper/323:01:243
2235499100,2cyclictest0-21swapper/322:50:223
2235399107,2cyclictest19942-21ssh22:31:162
2235399107,2cyclictest0-21swapper/223:25:282
2235399107,2cyclictest0-21swapper/222:14:392
2235399107,2cyclictest0-21swapper/220:55:132
2235399102,6cyclictest4556-21metacity19:10:582
2235399102,6cyclictest0-21swapper/200:10:592
2235399102,5cyclictest0-21swapper/220:30:022
2235399102,5cyclictest0-21swapper/219:43:022
2235399102,5cyclictest0-21swapper/200:36:592
2235399101,5cyclictest0-21swapper/220:00:002
2235399100,9cyclictest0-21swapper/223:11:352
2235399100,9cyclictest0-21swapper/222:07:462
2235399100,9cyclictest0-21swapper/221:29:212
2235399100,7cyclictest0-21swapper/223:04:022
2235399100,7cyclictest0-21swapper/221:06:592
2235399100,2cyclictest0-21swapper/223:33:242
2235299105,3cyclictest28811-21tune2fs19:25:151
2235199108,1cyclictest0-21swapper/020:25:180
223549994,3cyclictest8513-21grep22:20:143
223549994,3cyclictest30129-21cut20:50:183
223549994,3cyclictest29039-21kworker/u8:020:55:133
223549994,3cyclictest28602-21swap20:46:033
223549994,3cyclictest22633-21aten2.4_r3power19:10:113
223549994,3cyclictest21630-21tr20:30:133
223549994,3cyclictest16758-21unixbench_singl20:16:053
223549994,3cyclictest12051-21latency20:05:173
223549994,3cyclictest1092-21telnet21:00:123
223549993,4cyclictest1921-21tail19:40:163
223549991,3cyclictest3728-21runrttasks20:00:143
223539996,2cyclictest0-21swapper/200:30:272
223539994,3cyclictest3535-21gdbus19:25:042
223539990,7cyclictest0-21swapper/220:17:592
223539990,2cyclictest0-21swapper/200:05:292
223529994,3cyclictest19672-21tr20:25:141
223519994,3cyclictest224202sleep020:30:400
223519991,5cyclictest0-21swapper/020:05:120
223549983,3cyclictest31981-21cut19:35:113
223539983,3cyclictest27453-21tail19:20:162
223539983,3cyclictest23168-21grep22:01:032
223519984,2cyclictest0-21swapper/019:20:110
223519983,3cyclictest3020-21chrt21:05:050
223519983,3cyclictest15849-21cut20:15:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional