You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-10-15 - 02:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8s.osadl.org (updated Wed Oct 14, 2026 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
214692192143,26sleep00-21swapper/007:07:100
214692192143,26sleep00-21swapper/007:07:090
215952183128,47sleep20-21swapper/207:08:492
215952183128,47sleep20-21swapper/207:08:482
214402176101,28sleep30-21swapper/307:06:493
214402176101,28sleep30-21swapper/307:06:483
215172160102,29sleep10-21swapper/107:07:481
215172160102,29sleep10-21swapper/107:07:471
1531521360,3sleep10-21swapper/111:49:041
101672860,2sleep30-21swapper/310:08:543
62512690,2sleep20-21swapper/209:38:232
307262600,1sleep00-21swapper/009:32:020
35532560,1sleep10-21swapper/110:27:411
130362540,2sleep00-21swapper/011:46:460
10882540,1sleep20-21swapper/210:50:142
85132510,1sleep30-21swapper/309:40:243
79192510,3chrt0-21swapper/210:55:162
302572510,2chrt0-21swapper/012:00:120
23852480,2sleep10-21swapper/112:03:141
183692480,2chrt0-21swapper/210:15:112
303902450,1sleep20-21swapper/212:24:242
283722440,1sleep1211rcuc/109:56:351
262232440,2chrt0-21swapper/211:56:202
201972430,2sleep00-21swapper/011:04:480
165472430,1sleep10-21swapper/109:19:591
101372420,3chrt0-21swapper/207:55:232
247442410,1sleep10-21swapper/111:55:221
147252400,2sleep00-21swapper/010:11:430
2196299361,2cyclictest0-21swapper/011:30:430
185212350,2sleep00-21swapper/011:50:280
2196299345,27cyclictest5908-1kworker/u9:011:19:360
2196299341,24cyclictest0-21swapper/011:21:200
252422330,9sleep228-21ksoftirqd/210:44:162
21965993323,3cyclictest141rcu_preempt11:19:323
2196399331,7cyclictest4540-21diskmemload12:11:031
2196399331,29cyclictest9621-21ssh12:08:461
101912330,11sleep122-21ksoftirqd/109:42:031
265192320,2chrt0-21swapper/112:20:311
21965993222,7cyclictest27667-21ssh11:34:113
2196499321,6cyclictest24806-21ls08:30:182
2196599311,27cyclictest9440-21sh12:32:263
2196599311,27cyclictest9440-21sh12:32:253
2196599310,28cyclictest11257-21/usr/sbin/munin12:10:113
2196499311,27cyclictest4540-21diskmemload09:44:332
2196299311,5cyclictest21009-21ssh11:29:150
2196299310,6cyclictest8838-21ssh12:31:490
2196299310,6cyclictest8838-21ssh12:31:480
227712300,2chrt0-21swapper/309:52:443
2196599301,26cyclictest7293-21ssh09:12:323
2196499301,27cyclictest19057-21ssh09:49:132
2196399301,27cyclictest20663-21kworker/u8:211:01:501
2196399301,26cyclictest0-21swapper/112:15:001
44322290,2sleep20-21swapper/207:44:542
2196599299,5cyclictest34-21ksoftirqd/312:28:563
21965992924,4cyclictest34-21ksoftirqd/312:01:093
21965992922,5cyclictest15078-21ssh11:48:493
21965992921,6cyclictest2016-21mv07:37:123
2196599291,25cyclictest17519-21ssh11:25:453
2196599290,26cyclictest8778-21latency_hist07:55:003
2196599290,26cyclictest31554-21ssh11:36:203
2196599290,15cyclictest34-21ksoftirqd/310:10:163
2196499291,26cyclictest0-21swapper/211:19:022
2196399291,26cyclictest6236-21ssh11:17:541
2196399291,25cyclictest12340-21ssh12:35:061
21962992924,3cyclictest13622-21ssh10:59:570
21962992922,5cyclictest14769-21ssh12:12:120
2196299291,3cyclictest31071-21sh10:48:230
2196299291,3cyclictest24191-21ssh11:07:060
2196299291,3cyclictest12860-21sh09:16:220
2196299291,3cyclictest0-21swapper/012:18:340
2196299291,26cyclictest4446-21ssh12:29:100
2196299291,26cyclictest0-21swapper/010:26:160
2196299291,1cyclictest0-21swapper/009:45:540
44532280,2sleep20-21swapper/212:29:112
21965992823,3cyclictest30761-21ssh10:48:033
21965992822,3cyclictest19019-21ntp_states12:15:183
21965992815,11cyclictest34-21ksoftirqd/308:39:593
2196599280,25cyclictest17552-21ssh12:38:483
2196499282,24cyclictest4540-21diskmemload11:27:182
2196499281,3cyclictest11897-21hddtemp_smartct12:10:152
21963992824,2cyclictest0-21swapper/110:56:441
21963992823,4cyclictest0-21swapper/111:28:111
21963992823,3cyclictest23304-21ssh10:42:191
2196399281,2cyclictest0-21swapper/111:31:051
2196399281,2cyclictest0-21swapper/110:37:501
2196399281,25cyclictest0-21swapper/112:34:581
2196399281,25cyclictest0-21swapper/112:34:571
2196399281,25cyclictest0-21swapper/112:28:311
2196399281,25cyclictest0-21swapper/109:00:401
2196399281,25cyclictest0-21swapper/108:55:501
2196399281,25cyclictest0-21swapper/108:25:231
2196399281,25cyclictest0-21swapper/108:24:421
2196399280,3cyclictest23000-21ssh09:52:581
21962992823,4cyclictest7346-21ssh11:42:490
21962992819,7cyclictest7771-21sh12:06:540
2196299281,3cyclictest4540-21diskmemload09:43:460
2196299281,3cyclictest31189-21cut12:25:010
2196299281,25cyclictest0-21swapper/009:55:360
2196299281,25cyclictest0-21swapper/008:59:590
2196299281,25cyclictest0-21swapper/008:37:490
2196299281,25cyclictest0-21swapper/008:32:350
2196299281,25cyclictest0-21swapper/008:10:020
2196299281,25cyclictest0-21swapper/007:52:120
2196299280,26cyclictest53050irq/142-enp3s0-10:39:000
226292270,8sleep122-21ksoftirqd/111:05:301
2196599276,10cyclictest34-21ksoftirqd/312:22:413
21965992722,3cyclictest15399-21ssh09:45:333
2196599271,24cyclictest24629-21ssh11:07:313
2196599271,24cyclictest0-21swapper/311:57:563
2196599271,24cyclictest0-21swapper/308:28:453
2196599271,24cyclictest0-21swapper/308:04:593
2196599271,24cyclictest0-21swapper/307:57:353
2196599271,24cyclictest0-21swapper/307:40:473
21964992723,2cyclictest0-21swapper/208:35:122
21964992722,3cyclictest9502-21ssh12:32:292
21964992722,3cyclictest9502-21ssh12:32:282
21964992720,5cyclictest9851-21ssh11:45:082
21964992719,6cyclictest2752-21rm11:39:592
2196499271,24cyclictest7900-21ssh12:07:022
2196499271,24cyclictest0-21swapper/211:43:252
2196499270,25cyclictest16299-21ssh12:37:322
21963992724,2cyclictest0-21swapper/111:39:351
21963992724,2cyclictest0-21swapper/110:08:161
21963992724,2cyclictest0-21swapper/108:04:291
21963992724,1cyclictest0-21swapper/110:47:001
2196399271,25cyclictest0-21swapper/109:14:521
2196399271,24cyclictest0-21swapper/111:50:371
2196399271,24cyclictest0-21swapper/109:45:051
2196399271,24cyclictest0-21swapper/108:35:551
2196399271,24cyclictest0-21swapper/108:15:021
2196399271,24cyclictest0-21swapper/107:51:501
2196399271,24cyclictest0-21swapper/107:40:301
21962992725,1cyclictest0-21swapper/009:07:450
2196299271,25cyclictest0-21swapper/012:39:060
2196299271,25cyclictest0-21swapper/009:11:540
2196299271,25cyclictest0-21swapper/008:25:020
2196299271,25cyclictest0-21swapper/008:00:080
2196299271,24cyclictest4540-21diskmemload09:53:110
2196299271,24cyclictest0-21swapper/011:55:110
2196299271,24cyclictest0-21swapper/011:11:100
2196299271,24cyclictest0-21swapper/009:00:200
2196299271,24cyclictest0-21swapper/008:50:170
2196299271,24cyclictest0-21swapper/008:43:150
2196299271,24cyclictest0-21swapper/008:43:140
2196299271,24cyclictest0-21swapper/008:20:370
2196299271,24cyclictest0-21swapper/008:17:210
2196299271,24cyclictest0-21swapper/008:07:220
2196299271,24cyclictest0-21swapper/007:45:260
2196299271,24cyclictest0-21swapper/007:40:190
2196299271,24cyclictest0-21swapper/007:39:100
224052260,2sleep20-21swapper/208:25:162
2196599261,2cyclictest4540-21diskmemload10:00:213
2196599261,2cyclictest0-21swapper/311:52:173
2196599261,2cyclictest0-21swapper/311:23:073
2196599261,23cyclictest0-21swapper/311:00:393
2196599261,23cyclictest0-21swapper/310:56:293
2196599261,23cyclictest0-21swapper/310:42:403
2196599261,23cyclictest0-21swapper/310:32:453
2196599261,23cyclictest0-21swapper/308:46:473
2196599261,23cyclictest0-21swapper/308:40:043
2196599261,23cyclictest0-21swapper/308:40:033
2196599261,23cyclictest0-21swapper/308:30:393
2196599261,23cyclictest0-21swapper/308:18:373
21965992610,4cyclictest34-21ksoftirqd/310:25:363
21964992624,1cyclictest0-21swapper/211:33:092
21964992623,2cyclictest0-21swapper/211:53:372
21964992622,2cyclictest6080-21ls07:45:252
2196499261,2cyclictest0-21swapper/209:55:262
2196499261,24cyclictest0-21swapper/210:48:072
2196499261,24cyclictest0-21swapper/209:10:122
2196499261,24cyclictest0-21swapper/209:06:482
2196499261,23cyclictest4540-21diskmemload09:50:102
2196499261,23cyclictest0-21swapper/212:15:132
2196499261,23cyclictest0-21swapper/211:00:292
2196499261,23cyclictest0-21swapper/210:26:252
2196499261,23cyclictest0-21swapper/208:57:092
2196499261,23cyclictest0-21swapper/208:21:492
2196499261,23cyclictest0-21swapper/208:16:222
2196499261,23cyclictest0-21swapper/208:10:222
2196499261,23cyclictest0-21swapper/207:38:382
2196499261,1cyclictest0-21swapper/211:21:052
2196499260,24cyclictest30653-21ssh12:00:142
21963992623,2cyclictest0-21swapper/111:11:221
21963992623,2cyclictest0-21swapper/107:55:121
21963992621,3cyclictest10158-21sed11:20:231
2196399261,24cyclictest0-21swapper/111:41:201
2196399261,24cyclictest0-21swapper/108:05:051
2196399261,24cyclictest0-21swapper/107:45:231
2196399261,24cyclictest0-21swapper/107:39:461
2196399261,1cyclictest0-21swapper/109:29:121
2196399261,1cyclictest0-21swapper/108:52:511
2196399261,1cyclictest0-21swapper/108:44:141
2196399261,1cyclictest0-21swapper/108:44:131
2196399261,1cyclictest0-21swapper/108:30:201
2196399260,24cyclictest0-21swapper/109:05:421
2196399260,24cyclictest0-21swapper/108:45:081
2196399260,24cyclictest0-21swapper/108:10:071
21962992624,1cyclictest0-21swapper/009:29:030
21962992624,1cyclictest0-21swapper/008:45:450
21962992624,1cyclictest0-21swapper/007:55:580
2196299261,24cyclictest0-21swapper/011:36:450
2196299261,24cyclictest0-21swapper/010:07:130
2196299261,1cyclictest0-21swapper/010:50:330
2196599259,4cyclictest34-21ksoftirqd/309:27:053
2196599258,3cyclictest34-21ksoftirqd/309:31:493
21965992523,1cyclictest0-21swapper/309:08:033
21965992523,1cyclictest0-21swapper/309:01:233
21965992521,2cyclictest4540-21diskmemload12:05:043
2196599251,23cyclictest0-21swapper/311:40:063
2196599251,23cyclictest0-21swapper/308:56:343
2196599251,23cyclictest0-21swapper/308:21:143
2196599251,1cyclictest0-21swapper/311:13:023
2196599251,1cyclictest0-21swapper/310:54:153
2196599251,1cyclictest0-21swapper/307:49:073
2196599250,23cyclictest0-21swapper/309:55:413
2196599250,23cyclictest0-21swapper/308:10:053
2196599250,23cyclictest0-21swapper/308:05:553
21964992522,2cyclictest4540-21diskmemload11:12:052
2196499251,23cyclictest0-21swapper/211:07:162
2196499251,23cyclictest0-21swapper/210:39:312
2196499251,23cyclictest0-21swapper/209:15:472
2196499251,1cyclictest0-21swapper/209:00:322
2196499251,1cyclictest0-21swapper/208:05:392
2196499251,1cyclictest0-21swapper/208:04:542
2196499250,23cyclictest0-21swapper/208:52:062
2196499250,23cyclictest0-21swapper/208:40:382
2196499250,23cyclictest0-21swapper/208:40:372
2196499250,23cyclictest0-21swapper/207:51:262
21963992523,1cyclictest0-21swapper/109:32:591
21963992522,2cyclictest0-21swapper/110:00:281
2196399250,1cyclictest0-21swapper/110:51:081
21962992523,1cyclictest0-21swapper/010:34:160
21962992522,2cyclictest0-21swapper/010:42:320
2196599247,4cyclictest34-21ksoftirqd/309:24:113
21965992422,1cyclictest0-21swapper/308:50:103
2196599240,1cyclictest0-21swapper/310:38:403
21964992422,1cyclictest0-21swapper/209:29:042
21964992410,9cyclictest648-21ntpd10:10:212
2196499240,1cyclictest0-21swapper/210:00:272
2196599238,4cyclictest34-21ksoftirqd/310:16:223
2196599232,8cyclictest141rcu_preempt09:35:473
21965992317,4cyclictest34-21ksoftirqd/310:25:003
21964992321,1cyclictest0-21swapper/210:30:522
21964992321,1cyclictest0-21swapper/210:24:572
21964992321,1cyclictest0-21swapper/210:05:062
2196499230,1cyclictest0-21swapper/208:49:492
21965992216,4cyclictest34-21ksoftirqd/307:25:003
2196599220,12cyclictest4540-21diskmemload09:16:413
21964992213,6cyclictest25099-21pmu-power07:15:222
21963992118,2cyclictest0-21swapper/110:30:521
2196399211,5cyclictest0-21swapper/109:22:541
21963992111,7cyclictest31499-21ntp_states07:30:201
21962992119,1cyclictest0-21swapper/010:24:570
21962992113,6cyclictest25454-21ls07:15:250
2196299211,2cyclictest0-21swapper/009:23:370
2196599202,13cyclictest28446-21apt-get07:25:113
21965992014,4cyclictest34-21ksoftirqd/307:20:003
21963992014,4cyclictest22531-21cut07:10:161
21963992013,5cyclictest31374-21grep10:25:011
21962992018,1cyclictest0-21swapper/010:01:450
21962992011,6cyclictest28780-21diskstats07:25:150
2196599197,9cyclictest31395-21missed_timers07:30:183
2196599195,4cyclictest34-21ksoftirqd/307:11:323
2196499192,12cyclictest22003-21apt-get07:10:122
2196399191,5cyclictest0-21swapper/109:35:421
21963991913,4cyclictest30350-21idleruntime-cro07:30:001
21962991913,4cyclictest12-21ksoftirqd/009:40:010
21962991911,6cyclictest32250-21seq07:32:200
21964991812,4cyclictest30103-21sh09:31:252
21964991812,4cyclictest19111-21sh09:22:232
21964991810,6cyclictest31187-21cat07:30:152
2196399189,6cyclictest19363-21grep10:15:191
2196399181,5cyclictest0-21swapper/110:13:241
2196399181,5cyclictest0-21swapper/107:24:411
2196299186,4cyclictest12-21ksoftirqd/010:15:230
2196299182,11cyclictest26309-21apt-get07:20:130
2196299171,4cyclictest22470-21grep07:10:150
2196499168,5cyclictest29562-21mailstats07:25:232
2196499168,5cyclictest26429-21cpuspeed_turbos07:20:142
21963991611,3cyclictest24121-21/usr/sbin/munin07:15:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional