You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 20:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8s.osadl.org (updated Sat Aug 22, 2026 12:45:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122642164143,15sleep00-21swapper/007:09:580
122652163113,29sleep10-21swapper/107:09:591
120522162102,29sleep30-21swapper/307:07:163
122152157108,27sleep20-21swapper/207:09:242
121122930,2chrt0-21swapper/011:18:130
177132840,2sleep2271rcuc/212:10:152
239232740,1sleep20-21swapper/210:15:142
133732650,1sleep10-21swapper/110:30:311
129212630,2sleep10-21swapper/110:06:381
74952600,2sleep10-21swapper/112:02:201
195362600,2sleep219529-21strings12:35:202
99412590,2sleep334-21ksoftirqd/311:16:033
280582580,2sleep10-21swapper/111:54:091
310022570,2sleep00-21swapper/007:50:180
283762560,2sleep10-21swapper/107:45:131
94172530,2sleep334-21ksoftirqd/310:51:473
174812490,1sleep10-21swapper/110:58:081
80182460,2sleep228-21ksoftirqd/210:26:542
243082460,1sleep024309-21diskmemload12:39:270
76342450,1sleep30-21swapper/311:38:583
284152450,2sleep10-21swapper/112:18:061
230932450,3chrt0-21swapper/009:50:200
225722450,1sleep30-21swapper/311:25:263
238472430,1sleep10-21swapper/112:39:001
230842420,1sleep30-21swapper/312:38:143
299332380,2chrt0-21swapper/211:55:152
161912350,2sleep20-21swapper/210:33:202
286562340,7sleep2281ksoftirqd/209:30:242
20032310,2chrt0-21swapper/312:22:213
20032310,2chrt0-21swapper/312:22:203
1254599319,10cyclictest294032switchtime11:30:253
12541993024,3cyclictest31602-21taskset09:06:181
110432300,4sleep0121ksoftirqd/010:05:210
216582290,1sleep00-21swapper/009:50:010
1254599293,9cyclictest15609-21ssh11:20:233
1254299291,25cyclictest19996-21hddtemp_smartct07:25:152
1254099291,26cyclictest0-21swapper/007:22:370
1254599283,7cyclictest23190-21ssh11:02:043
1254099281,25cyclictest0-21swapper/008:43:320
1254099281,25cyclictest0-21swapper/007:27:500
1254599274,9cyclictest26916-21ssh10:16:563
1254599274,7cyclictest34-21ksoftirqd/312:29:483
1254599273,7cyclictest24060-21ssh10:39:273
1254599272,6cyclictest12436-21ssh11:42:003
1254599271,9cyclictest27869-21ssh11:53:583
12541992724,2cyclictest0-21swapper/107:16:201
1254199271,25cyclictest0-21swapper/107:26:451
1254199271,25cyclictest0-21swapper/107:23:241
1254199271,24cyclictest0-21swapper/108:41:041
1254199271,24cyclictest0-21swapper/108:06:201
1254199271,24cyclictest0-21swapper/107:30:071
1254099271,24cyclictest0-21swapper/009:06:270
1254099271,24cyclictest0-21swapper/008:45:020
1254099271,24cyclictest0-21swapper/008:05:570
1254099271,24cyclictest0-21swapper/007:38:440
1254099271,24cyclictest0-21swapper/007:30:340
239562260,2sleep30-21swapper/308:50:153
1254599266,7cyclictest34-21ksoftirqd/312:03:143
1254599263,8cyclictest18034-21ssh11:45:513
1254599263,8cyclictest15246-21ssh10:08:573
1254599263,6cyclictest9580-21ssh10:28:283
1254599263,6cyclictest16198-21ssh09:21:213
1254599262,8cyclictest5077-21ssh11:12:553
1254599261,23cyclictest0-21swapper/309:06:433
1254599261,23cyclictest0-21swapper/307:40:313
1254599261,23cyclictest0-21swapper/307:40:303
1254599261,23cyclictest0-21swapper/307:34:023
1254599261,23cyclictest0-21swapper/307:26:123
1254599261,23cyclictest0-21swapper/307:22:263
1254599261,23cyclictest0-21swapper/307:15:013
1254299261,24cyclictest0-21swapper/207:22:182
1254299261,23cyclictest0-21swapper/207:17:142
1254199261,24cyclictest0-21swapper/107:53:521
1254099260,24cyclictest0-21swapper/008:04:560
1254099260,24cyclictest0-21swapper/007:17:340
1254599254,4cyclictest0-21swapper/309:52:343
1254599253,6cyclictest30185-21ssh10:43:363
1254599253,6cyclictest10319-21ssh09:40:313
1254599252,8cyclictest20961-21ssh10:12:433
1254599252,7cyclictest932-21ssh09:58:113
1254599252,6cyclictest19181-21rm12:10:343
1254599252,6cyclictest15310-21ssh10:55:553
12545992517,5cyclictest15197-21ssh09:45:073
1254599251,6cyclictest0-21swapper/310:33:363
1254599251,23cyclictest0-21swapper/308:41:313
1254599251,23cyclictest0-21swapper/307:16:513
1254599251,1cyclictest0-21swapper/308:39:253
1254599251,1cyclictest0-21swapper/307:39:313
1254599250,23cyclictest0-21swapper/308:45:023
1254299253,15cyclictest1686-21ssh09:35:112
12542992523,1cyclictest0-21swapper/209:05:442
12542992523,1cyclictest0-21swapper/208:40:422
12542992522,2cyclictest0-21swapper/208:15:412
12542992517,6cyclictest1328-21ssh09:58:352
1254299251,23cyclictest0-21swapper/208:06:002
1254299251,22cyclictest0-21swapper/208:45:072
1254299250,23cyclictest0-21swapper/207:31:002
12541992523,1cyclictest0-21swapper/109:04:021
12541992523,1cyclictest0-21swapper/108:45:031
12541992523,1cyclictest0-21swapper/107:39:191
1254199251,1cyclictest0-21swapper/107:40:301
1254199251,1cyclictest0-21swapper/107:40:301
12540992517,6cyclictest25973-21sh10:15:590
294022240,2sleep00-21swapper/011:30:240
227982240,2sleep20-21swapper/210:14:342
1254599247,6cyclictest34-21ksoftirqd/312:33:023
1254599246,6cyclictest34-21ksoftirqd/308:27:343
12545992422,1cyclictest0-21swapper/309:04:023
1254099243,15cyclictest10618-21ssh12:05:130
12540992422,1cyclictest0-21swapper/007:41:090
12540992422,1cyclictest0-21swapper/007:41:090
1254099242,16cyclictest25118-21ssh10:40:030
1254099242,16cyclictest19819-21ssh11:00:120
1254599239,4cyclictest66050lldpd09:31:433
1254599233,6cyclictest8915-21ssh10:04:243
1254599233,5cyclictest28310-21ssh12:17:583
1254599230,1cyclictest0-21swapper/307:59:533
12542992321,1cyclictest0-21swapper/208:04:492
12542992321,1cyclictest0-21swapper/207:40:492
12542992321,1cyclictest0-21swapper/207:40:492
12542992321,1cyclictest0-21swapper/207:39:322
12542992314,7cyclictest23691-21ntp_states11:50:222
1254299231,20cyclictest20862-21ntp_states11:00:222
1254299231,15cyclictest20591-21ssh09:25:142
1254299230,1cyclictest0-21swapper/208:39:372
1254199231,8cyclictest29335-21ssh11:55:011
12541992316,5cyclictest1683-21sh11:34:451
12541992313,7cyclictest15393-21ntp_kernel_pll_11:20:211
12540992316,5cyclictest22072-21rm11:49:530
12540992311,10cyclictest13671-21cut09:20:130
1254099231,10cyclictest290032which09:00:220
1254599226,6cyclictest34-21ksoftirqd/310:45:353
1254599226,6cyclictest34-21ksoftirqd/308:24:113
1254599225,4cyclictest0-21swapper/311:57:503
1254599224,5cyclictest27615-21ntp_states11:05:223
1254599222,6cyclictest9742-21ssh09:16:433
1254599222,6cyclictest34-21ksoftirqd/309:28:513
12545992217,3cyclictest34-21ksoftirqd/308:06:183
1254599221,6cyclictest23553-21kworker/u8:009:12:163
1254599221,5cyclictest331rcuc/312:08:283
1254299223,3cyclictest31910-21diskmemload11:06:372
12542992212,6cyclictest14766-21cut09:20:222
1254199221,5cyclictest4091-21memory10:00:191
12541992213,7cyclictest25338-21awk10:15:271
12541992212,8cyclictest8043-21seq08:11:481
1254199221,18cyclictest52850irq/140-enp3s0-10:45:131
1254199220,20cyclictest25969-21seq11:04:521
12540992220,1cyclictest0-21swapper/007:59:400
1254099220,8cyclictest44662ssh09:13:130
118292220,9sleep122-21ksoftirqd/109:18:461
117492220,2sleep20-21swapper/212:30:102
105512220,1sleep00-21swapper/009:40:450
94432210,2sleep00-21swapper/010:28:200
130122210,16sleep10-21swapper/109:43:101
1254599210,6cyclictest34-21ksoftirqd/310:20:343
1254599210,5cyclictest1666-21apt-get09:35:123
12542992112,7cyclictest959-21swap10:45:242
12542992110,7cyclictest12789-21apt-get07:10:112
1254199219,10cyclictest2840-21ssh10:23:281
1254199216,3cyclictest141rcu_preempt11:15:161
12541992113,6cyclictest9115-21smartctl08:15:161
12541992113,6cyclictest27485-21seq08:58:391
12541992112,7cyclictest16558-21seq12:09:411
1254099213,13cyclictest31910-21diskmemload11:40:130
1254099213,12cyclictest3857-21apt-get12:00:120
1254099212,13cyclictest854-21ssh11:10:110
12540992114,4cyclictest31910-21diskmemload10:30:260
12540992114,4cyclictest12646-21sh10:55:010
12545992012,6cyclictest6417-21apt-get08:10:113
12545992012,6cyclictest28962-21grep07:45:193
1254299207,8cyclictest28-21ksoftirqd/208:30:122
1254299207,4cyclictest5419-21ssh11:36:452
1254299202,12cyclictest8519-21apt-get09:40:142
12542992018,1cyclictest0-21swapper/207:53:522
12542992014,4cyclictest9379-21sh09:16:212
12542992013,5cyclictest9961-21apt-get10:05:122
12542992013,5cyclictest19522-21sh11:23:522
12542992012,6cyclictest9270-21sed11:15:262
12542992012,6cyclictest4715-21load12:00:192
12542992011,6cyclictest52750irq/139-enp3s0-09:45:132
1254199202,15cyclictest8688-21sendmail11:40:001
1254199201,5cyclictest0-21swapper/111:05:271
12541992012,6cyclictest955-21ntpq09:10:211
12541992012,6cyclictest25765-21seq11:28:241
12541992012,6cyclictest25498-21cat10:40:131
12541992012,6cyclictest2071-21ssh09:59:201
12541992012,6cyclictest17708-21entropy12:10:151
12541992012,6cyclictest14315-21seq07:10:331
12541992012,6cyclictest12843-21ntpq12:30:201
12541992012,6cyclictest1159-21expr07:55:231
12541992011,7cyclictest27762-21cat09:30:161
12541992011,6cyclictest2283-21timerandwakeup11:10:221
12541992010,7cyclictest11669-21pluginstate08:20:211
1254199200,7cyclictest31910-21diskmemload09:50:221
1254099207,10cyclictest22318-21processes11:25:240
1254099206,11cyclictest4008-21kworker/u8:109:55:130
1254099201,8cyclictest24712-21if_enp3s012:15:170
12540992018,1cyclictest0-21swapper/008:23:000
1254099201,6cyclictest23955-21fschecks_count08:50:150
1254099201,5cyclictest0-21swapper/010:46:430
12540992013,4cyclictest18136-21perf12:35:000
1254099200,18cyclictest12194-21ssh09:19:080
9932190,3chrt0-21swapper/211:34:042
325142190,1sleep20-21swapper/207:55:132
12545991911,6cyclictest17061-21cut08:35:003
1254599191,13cyclictest25725-21taskset08:55:133
1254299199,8cyclictest0-21swapper/211:10:232
1254299198,10cyclictest5279-21ssh10:00:462
1254299194,3cyclictest141rcu_preempt12:20:142
1254299194,3cyclictest141rcu_preempt12:20:132
1254299192,10cyclictest32344-21diskmemload09:10:112
12542991913,4cyclictest27852-21/usr/sbin/munin09:00:172
12542991913,4cyclictest27016-21sh12:16:412
12542991911,6cyclictest7660-21readlink10:50:242
12542991911,6cyclictest26295-21cat08:55:172
12542991911,6cyclictest23926-21forks08:50:152
12542991911,6cyclictest22144-21ntp_kernel_pll_11:25:232
12542991911,6cyclictest13796-21if_err_enp3s010:55:172
12542991910,6cyclictest15445-21cron11:45:002
1254199197,10cyclictest16301-21ntp_kernel_err09:45:201
12541991914,3cyclictest13501-21acpi09:20:111
12541991913,4cyclictest7705-21sh09:39:411
12541991913,4cyclictest31910-21diskmemload11:42:331
12541991913,4cyclictest11772-21sh10:54:081
12541991912,5cyclictest32258-21wc12:20:251
12541991912,5cyclictest32258-21wc12:20:251
12541991912,5cyclictest16698-21seq08:32:391
12541991911,6cyclictest2137-21cat08:00:111
12541991911,6cyclictest18867-21seq08:38:061
1254099198,7cyclictest13094-21apt-get10:55:130
1254099195,5cyclictest18415-21cpuspeed_turbos10:35:140
1254099193,8cyclictest30454-21apt-get10:20:110
1254099192,12cyclictest12870-21apt-get08:25:140
12540991914,4cyclictest12-21ksoftirqd/011:55:000
12540991914,4cyclictest12-21ksoftirqd/011:40:000
12540991913,4cyclictest5112-21sh12:25:120
12540991913,4cyclictest24905-21sh09:28:010
1254599182,3cyclictest34-21ksoftirqd/307:50:163
12545991810,5cyclictest9627-21seq08:15:213
12542991812,4cyclictest4987-21sh12:25:082
12542991812,4cyclictest31203-21kernelversion10:20:182
12542991812,4cyclictest26392-21sh09:53:012
12542991811,5cyclictest7719-21sed08:10:242
12542991811,4cyclictest31910-21diskmemload11:45:582
12542991810,6cyclictest29090-21cut07:45:212
12542991810,5cyclictest18894-21grep10:35:172
12541991813,3cyclictest22468-21sh09:25:371
12541991812,4cyclictest20208-21sh10:35:361
12541991811,5cyclictest17945-21ntpq10:10:191
12541991811,5cyclictest14503-21seq08:26:571
12541991811,4cyclictest5827-21if_err_enp3s012:25:181
12541991810,6cyclictest5245-21forks10:25:161
12541991810,6cyclictest16314-21uniq11:45:161
1254099188,7cyclictest560-21dbus-daemon11:55:010
1254099181,4cyclictest0-21swapper/010:00:500
12540991813,3cyclictest2050-21sh09:35:130
12540991812,4cyclictest31910-21diskmemload11:06:430
12540991812,4cyclictest31910-21diskmemload10:10:090
12540991812,4cyclictest31910-21diskmemload09:30:350
12540991812,4cyclictest14215-21sh11:20:040
12540991811,5cyclictest29000-21awk07:45:190
1254099181,15cyclictest10042-21sed08:15:250
12540991811,4cyclictest31910-21diskmemload12:20:140
12540991811,4cyclictest31910-21diskmemload12:20:140
12540991810,6cyclictest18686-21sed12:10:240
12540991810,5cyclictest25701-21cat08:55:120
1254299171,5cyclictest25281-21apt-get10:40:122
12542991710,5cyclictest11824-21tr08:20:222
12542991710,4cyclictest12310-21head12:05:272
12541991710,5cyclictest23739-21cat08:50:131
12540991710,5cyclictest17481-21seq08:35:160
12540991710,5cyclictest13102-21expr07:10:120
1254599162,4cyclictest0-21swapper/308:00:023
1254299168,6cyclictest13673-21cat08:25:202
12540991611,3cyclictest14982-21/usr/sbin/munin08:30:170
12540991610,4cyclictest6548-21expr08:10:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional