You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 17:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 22, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11902993028,1cyclictest34-21ksoftirqd/310:05:003
1190299260,0cyclictest0-21swapper/309:46:553
11896992625,1cyclictest22-21ksoftirqd/109:46:551
1189299260,25cyclictest313-21systemd-journal07:20:000
11902992523,1cyclictest0-21swapper/311:25:233
1189899250,24cyclictest0-21swapper/210:54:052
1189899250,24cyclictest0-21swapper/207:10:212
1189699250,24cyclictest10349-21phc2sys-jitter12:05:291
1189699250,0cyclictest0-21swapper/111:29:491
11902992419,1cyclictest0-21swapper/310:59:033
1190299240,23cyclictest0-21swapper/310:47:463
11898992422,1cyclictest20744-21mailstats11:45:302
11898992419,4cyclictest0-21swapper/209:48:552
1189899240,23cyclictest6031-21diskmemload09:39:272
11896992420,0cyclictest0-21swapper/110:19:041
1189699240,24cyclictest0-21swapper/109:58:241
1189699240,24cyclictest0-21swapper/109:33:121
1189699240,21cyclictest0-21swapper/111:37:101
1189699240,1cyclictest6031-21diskmemload10:00:101
1189299240,24cyclictest0-21swapper/011:19:240
1189299240,1cyclictest15846-21ssh09:46:030
1189299240,0cyclictest6031-21diskmemload11:53:090
11902992323,0cyclictest6031-21diskmemload12:32:033
11902992323,0cyclictest6031-21diskmemload11:57:323
11902992323,0cyclictest6031-21diskmemload11:09:513
11902992323,0cyclictest0-21swapper/312:39:573
11902992323,0cyclictest0-21swapper/312:29:553
11902992323,0cyclictest0-21swapper/311:51:193
11902992323,0cyclictest0-21swapper/311:35:563
11902992323,0cyclictest0-21swapper/311:19:193
11902992323,0cyclictest0-21swapper/310:27:483
11902992323,0cyclictest0-21swapper/310:20:403
11902992323,0cyclictest0-21swapper/310:18:353
11902992323,0cyclictest0-21swapper/309:19:413
11902992323,0cyclictest0-21swapper/309:12:043
11902992323,0cyclictest0-21swapper/308:35:223
1190299230,3cyclictest24358-21latency_hist11:50:013
1190299230,2cyclictest24303-21ssh12:18:273
1190299230,23cyclictest0-21swapper/310:31:563
1190299230,22cyclictest8020-21sh10:09:123
1190299230,22cyclictest6031-21diskmemload09:22:133
1190299230,22cyclictest31897-21apt-get07:50:213
1190299230,22cyclictest27035-21rm09:56:033
1190299230,22cyclictest0-21swapper/312:12:473
1190299230,22cyclictest0-21swapper/310:35:043
1190299230,22cyclictest0-21swapper/309:33:063
1190299230,0cyclictest151rcu_preempt10:54:213
1190299230,0cyclictest0-21swapper/311:33:563
1190299230,0cyclictest0-21swapper/311:00:523
1190299230,0cyclictest0-21swapper/309:37:543
11898992323,0cyclictest0-21swapper/212:36:532
11898992323,0cyclictest0-21swapper/212:21:232
11898992323,0cyclictest0-21swapper/210:10:492
11898992323,0cyclictest0-21swapper/210:08:212
11898992321,1cyclictest8624-21ssh09:10:442
11898992321,1cyclictest4541-21memory12:00:272
11898992321,1cyclictest0-21swapper/212:15:132
11898992321,1cyclictest0-21swapper/211:25:502
11898992321,1cyclictest0-21swapper/210:48:022
11898992320,3cyclictest0-21swapper/210:21:112
11898992318,4cyclictest0-21swapper/212:30:282
1189899230,23cyclictest0-21swapper/210:04:362
1189899230,22cyclictest4656-21sh11:31:052
1189899230,22cyclictest16923-21sed10:15:312
1189899230,0cyclictest6031-21diskmemload11:15:352
1189899230,0cyclictest0-21swapper/212:25:442
1189899230,0cyclictest0-21swapper/212:11:332
1189899230,0cyclictest0-21swapper/210:55:322
11896992323,0cyclictest0-21swapper/112:35:561
11896992323,0cyclictest0-21swapper/112:19:471
11896992323,0cyclictest0-21swapper/111:20:161
11896992323,0cyclictest0-21swapper/110:56:511
11896992323,0cyclictest0-21swapper/110:28:571
11896992323,0cyclictest0-21swapper/109:50:181
11896992323,0cyclictest0-21swapper/109:41:381
11896992322,1cyclictest6031-21diskmemload09:24:221
11896992321,1cyclictest17049-21ssh11:14:281
1189699230,23cyclictest6031-21diskmemload11:07:201
1189699230,23cyclictest26214-21ssh10:53:061
1189699230,23cyclictest0-21swapper/110:43:161
1189699230,22cyclictest9702-21ssh09:12:021
1189699230,22cyclictest8938-21ssh12:33:331
1189699230,22cyclictest6432-21sh12:01:561
1189699230,22cyclictest16465-21ssh10:45:101
1189699230,22cyclictest14825-21ssh12:10:241
1189699230,1cyclictest23208-21ssh10:21:101
1189699230,0cyclictest0-21swapper/111:00:311
1189699230,0cyclictest0-21swapper/110:11:101
1189699230,0cyclictest0-21swapper/109:18:541
11892992323,0cyclictest6031-21diskmemload12:29:210
11892992323,0cyclictest6031-21diskmemload12:10:150
11892992323,0cyclictest6031-21diskmemload10:37:370
11892992323,0cyclictest0-21swapper/011:40:110
11892992323,0cyclictest0-21swapper/011:37:460
11892992323,0cyclictest0-21swapper/010:53:550
11892992322,1cyclictest0-21swapper/009:31:320
11892992321,1cyclictest0-21swapper/011:10:230
11892992321,1cyclictest0-21swapper/009:10:240
11892992320,2cyclictest23343-21ssh10:21:300
1189299230,23cyclictest6031-21diskmemload09:26:300
1189299230,23cyclictest0-21swapper/011:20:450
1189299230,23cyclictest0-21swapper/010:09:010
1189299230,23cyclictest0-21swapper/009:57:230
1189299230,22cyclictest606-21dbus-daemon08:00:010
1189299230,22cyclictest5398-21diskstats12:30:260
1189299230,22cyclictest24225-21latency_hist09:55:000
1189299230,22cyclictest21291-21rm09:22:220
1189299230,22cyclictest19216-21ssh11:45:190
1189299230,22cyclictest1120-21ssh10:02:180
1189299230,1cyclictest30120-21diskmemload10:55:490
1189299230,1cyclictest0-21swapper/012:02:270
1189299230,0cyclictest0-21swapper/012:35:340
1189299230,0cyclictest0-21swapper/010:16:050
11902992222,0cyclictest0-21swapper/311:10:313
11902992219,2cyclictest14290-21cron07:15:003
1190299220,21cyclictest19121-21dump-pmu-power07:25:003
1190299220,21cyclictest0-21swapper/312:00:313
1190299220,21cyclictest0-21swapper/311:20:013
1190299220,21cyclictest0-21swapper/309:25:103
1190299220,21cyclictest0-21swapper/308:20:213
1190299220,1cyclictest9096-21apt-get10:10:223
1190299220,1cyclictest3666-21perf09:05:003
1190299220,1cyclictest0-21swapper/311:43:563
1190299220,1cyclictest0-21swapper/310:40:383
1190299220,0cyclictest6031-21diskmemload09:50:383
11898992222,0cyclictest0-21swapper/211:10:432
11898992222,0cyclictest0-21swapper/210:28:492
11898992222,0cyclictest0-21swapper/209:17:432
11898992220,1cyclictest23871-21sh09:54:262
11898992220,1cyclictest0-21swapper/210:41:322
11898992220,1cyclictest0-21swapper/209:20:272
11898992220,1cyclictest0-21swapper/208:25:222
11898992219,0cyclictest0-21swapper/211:35:552
1189899220,21cyclictest26746-21apt-get08:45:222
1189899220,21cyclictest0-21swapper/211:55:282
1189899220,21cyclictest0-21swapper/211:40:032
1189899220,21cyclictest0-21swapper/211:20:102
1189899220,21cyclictest0-21swapper/211:06:282
1189899220,21cyclictest0-21swapper/209:40:172
1189899220,1cyclictest6031-21diskmemload10:31:022
1189899220,1cyclictest0-21swapper/209:55:592
1189899220,0cyclictest6031-21diskmemload09:32:062
1189899220,0cyclictest6031-21diskmemload09:26:522
11896992221,1cyclictest0-21swapper/112:25:011
11896992221,0cyclictest2453-21apt-get09:35:231
11896992220,1cyclictest19119-21turbostat07:25:001
1189699220,22cyclictest3572-21apt-get10:05:231
1189699220,21cyclictest6196-21irqstats10:35:271
1189699220,21cyclictest28297-21sh12:21:141
1189699220,21cyclictest2443-21ssh11:30:241
1189699220,21cyclictest21938-21apt-get08:35:221
1189699220,21cyclictest0-21swapper/111:15:221
1189699220,0cyclictest0-21swapper/111:43:021
11892992222,0cyclictest0-21swapper/009:35:020
11892992221,1cyclictest0-21swapper/010:33:220
11892992220,1cyclictest313-21systemd-journal09:05:280
1189299220,2cyclictest9522-21cstates10:10:230
1189299220,22cyclictest0-21swapper/010:26:500
1189299220,21cyclictest32161-21rm11:27:090
1189299220,21cyclictest21800-21apt-get07:30:210
1189299220,21cyclictest21507-21latency_hist07:30:000
1189299220,21cyclictest14754-21apt-get08:20:210
1189299220,21cyclictest13785-21ssh09:15:270
1189299220,1cyclictest8944-21ssh12:05:100
1189299220,1cyclictest32334-21sh11:55:420
1189299220,1cyclictest16538-21ssh10:45:160
1189299220,1cyclictest10966-21ssh09:42:030
1189299220,1cyclictest0-21swapper/010:40:230
1189299220,0cyclictest0-21swapper/011:06:010
1189299220,0cyclictest0-21swapper/007:40:020
1189299220,0cyclictest0-21swapper/007:40:020
11902992120,0cyclictest0-21swapper/308:50:203
1190299210,2cyclictest9214-21dump-pmu-power08:10:003
1190299210,20cyclictest19405-21apt-get07:25:233
1190299210,20cyclictest0-21swapper/307:35:213
1190299210,1cyclictest11999-21latency_hist08:15:003
1190299210,1cyclictest0-21swapper/307:40:023
1190299210,1cyclictest0-21swapper/307:40:023
11898992121,0cyclictest0-21swapper/211:50:152
11898992120,1cyclictest0-21swapper/211:00:012
1189899210,20cyclictest6031-21diskmemload12:05:412
1189899210,20cyclictest0-21swapper/208:10:022
1189899210,20cyclictest0-21swapper/208:05:222
1189899210,0cyclictest0-21swapper/207:50:212
1189899210,0cyclictest0-21swapper/207:40:232
1189899210,0cyclictest0-21swapper/207:40:232
11896992120,1cyclictest19238-21ssh11:45:201
1189699210,21cyclictest0-21swapper/109:25:101
1189699210,21cyclictest0-21swapper/108:55:221
1189699210,21cyclictest0-21swapper/108:20:211
11892992121,0cyclictest17146-21apt-get08:25:210
1189299210,21cyclictest0-21swapper/012:20:030
1189299210,20cyclictest0-21swapper/008:10:230
1189299210,1cyclictest0-21swapper/011:00:260
1189299210,0cyclictest29139-21apt-get08:50:210
11902992020,0cyclictest0-21swapper/308:30:233
1190299200,0cyclictest0-21swapper/307:15:203
11898992020,0cyclictest0-21swapper/208:15:212
11898992020,0cyclictest0-21swapper/208:00:222
1189899200,19cyclictest26440-21cron08:45:012
1189899200,0cyclictest0-21swapper/208:30:232
1189899200,0cyclictest0-21swapper/207:30:212
1189899200,0cyclictest0-21swapper/207:25:232
1189899200,0cyclictest0-21swapper/207:20:212
11896992020,0cyclictest26407-21apt-get07:40:021
11896992020,0cyclictest26407-21apt-get07:40:021
11896992020,0cyclictest0-21swapper/108:25:211
11896992020,0cyclictest0-21swapper/107:50:211
11896992015,2cyclictest22-21ksoftirqd/107:30:001
11892992018,1cyclictest26417-21sh07:40:000
1189299200,20cyclictest0-21swapper/008:35:220
11902991917,1cyclictest19267-21perf08:30:003
11898991919,0cyclictest0-21swapper/208:50:202
11898991919,0cyclictest0-21swapper/207:55:212
11898991917,1cyclictest0-21swapper/208:20:212
11898991916,2cyclictest24035-21apt08:40:012
11896991919,0cyclictest0-21swapper/107:15:201
11896991918,1cyclictest28850-21turbostat.cron08:50:011
1189699190,19cyclictest0-21swapper/108:05:031
11892991919,0cyclictest0-21swapper/008:40:240
11892991916,2cyclictest607-21in:imuxsock08:05:000
11898991818,0cyclictest29505-21apt-get07:45:232
11898991818,0cyclictest0-21swapper/207:35:222
11896991816,1cyclictest619-21polkitd07:15:001
11896991816,1cyclictest19544-21apt-get08:30:231
11892991818,0cyclictest0-21swapper/008:15:210
11902991717,0cyclictest0-21swapper/307:45:233
11902991717,0cyclictest0-21swapper/307:30:213
11896991717,0cyclictest0-21swapper/108:50:201
11892991717,0cyclictest0-21swapper/008:05:030
11896991614,1cyclictest0-21swapper/108:14:231
1189699160,15cyclictest25260-21memory08:40:281
11892991616,0cyclictest0-21swapper/007:45:230
11892991616,0cyclictest0-21swapper/007:10:200
11902991515,0cyclictest0-21swapper/309:05:213
1190299150,8cyclictest0-21swapper/308:45:223
1190299150,15cyclictest32165-21munin-node08:15:543
11898991515,0cyclictest14592-21apt-get07:15:202
11898991515,0cyclictest0-21swapper/209:05:212
11896991515,0cyclictest0-21swapper/107:30:211
1189299154,9cyclictest611-21irqbalance07:20:090
11892991515,0cyclictest0-21swapper/009:00:230
11892991514,1cyclictest26746-21apt-get08:45:220
1190299141,0cyclictest151rcu_preempt08:40:273
1190299140,14cyclictest0-21swapper/308:00:493
1190299140,14cyclictest0-21swapper/307:58:033
1190299140,0cyclictest0-21swapper/308:55:143
11898991414,0cyclictest0-21swapper/208:55:222
1189899140,14cyclictest0-21swapper/209:01:262
11896991414,0cyclictest0-21swapper/108:15:351
11896991414,0cyclictest0-21swapper/107:55:191
1189699140,14cyclictest0-21swapper/109:01:231
1189699140,0cyclictest0-21swapper/109:05:091
1189299140,14cyclictest0-21swapper/008:55:140
1189299140,0cyclictest0-21swapper/007:50:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional