You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 21:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Jul 15, 2026 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1208421660,4sleep22528399cyclictest12:08:052
873021510,3sleep02527399cyclictest13:10:060
1068911450,8ptp4l10871-21kworker/3:209:05:593
307162870,2sleep10-21swapper/110:24:221
106891710,1ptp4l401ktimersoftd/313:04:543
320552670,2sleep30-21swapper/311:21:453
279652620,2sleep20-21swapper/209:13:582
279652620,2sleep20-21swapper/209:13:582
25273996250,7cyclictest9-21ksoftirqd/009:29:100
106891600,1ptp4l401ktimersoftd/313:18:273
2527899588,25cyclictest2460-21sed09:24:251
249842564,39sleep20-21swapper/209:06:352
251632554,10sleep10-21swapper/109:08:521
25273994940,4cyclictest9-21ksoftirqd/009:54:110
25273994842,3cyclictest9-21ksoftirqd/013:14:060
25273994729,3cyclictest9-21ksoftirqd/009:19:100
25273994522,4cyclictest9-21ksoftirqd/010:29:250
25273994516,6cyclictest9-21ksoftirqd/012:29:120
180522450,1sleep30-21swapper/314:27:063
25273994438,3cyclictest9-21ksoftirqd/011:09:030
25273994420,4cyclictest9-21ksoftirqd/013:24:160
25273994412,6cyclictest9-21ksoftirqd/012:34:150
2529199430,3cyclictest30735-21/usr/sbin/munin10:24:253
25273994331,3cyclictest9-21ksoftirqd/011:39:020
25273994327,13cyclictest9-21ksoftirqd/012:59:170
25273994320,4cyclictest9-21ksoftirqd/011:54:160
25273994318,4cyclictest9-21ksoftirqd/011:29:220
2527899420,4cyclictest27901-21seq11:49:451
25273994232,3cyclictest9-21ksoftirqd/009:59:190
25273994218,4cyclictest9-21ksoftirqd/011:59:300
2529199411,35cyclictest0-21swapper/313:54:163
25273994121,9cyclictest9-21ksoftirqd/010:09:270
25273994118,4cyclictest9-21ksoftirqd/012:49:200
25273994118,4cyclictest9-21ksoftirqd/012:49:200
25273994116,4cyclictest9-21ksoftirqd/014:37:430
25291994015,21cyclictest29681-21grep12:59:163
2527899402,10cyclictest6562-21apt-get13:09:151
2527399408,3cyclictest9-21ksoftirqd/012:19:000
25273994017,7cyclictest9-21ksoftirqd/010:24:270
2527899394,28cyclictest9914-21ssh14:19:151
2527899393,3cyclictest0-21swapper/113:52:091
2527899392,31cyclictest0-21swapper/111:19:121
2527899390,4cyclictest13580-21ssh12:42:521
25273993934,3cyclictest9-21ksoftirqd/014:24:160
25273993933,3cyclictest9-21ksoftirqd/011:44:120
25273993933,3cyclictest9-21ksoftirqd/011:39:000
25273993930,3cyclictest9-21ksoftirqd/012:04:230
25273993928,3cyclictest9-21ksoftirqd/014:19:180
25273993927,10cyclictest9-21ksoftirqd/012:24:320
25273993926,10cyclictest9-21ksoftirqd/013:39:190
25273993924,12cyclictest9-21ksoftirqd/009:49:110
25273993917,3cyclictest9-21ksoftirqd/009:09:120
25273993917,3cyclictest9-21ksoftirqd/009:09:120
25273993916,4cyclictest9-21ksoftirqd/014:14:150
25273993915,4cyclictest9-21ksoftirqd/013:04:090
2527399390,7cyclictest9-21ksoftirqd/010:53:580
106891390,1ptp4l401ktimersoftd/314:04:103
106891390,1ptp4l401ktimersoftd/314:03:113
106891390,1ptp4l401ktimersoftd/313:45:283
106891390,1ptp4l401ktimersoftd/313:32:453
106891390,1ptp4l401ktimersoftd/313:21:013
106891390,1ptp4l401ktimersoftd/312:40:243
106891390,1ptp4l401ktimersoftd/311:58:013
106891390,1ptp4l401ktimersoftd/311:36:013
25291993817,18cyclictest10611-21irqrtprio14:19:223
2527899383,30cyclictest64-21kswapd014:14:151
2527899382,31cyclictest0-21swapper/113:34:151
2527899382,30cyclictest0-21swapper/110:39:101
2527899380,6cyclictest15468-21ps14:24:231
2527399389,5cyclictest9-21ksoftirqd/013:44:330
25273993832,3cyclictest9-21ksoftirqd/013:59:030
25273993815,4cyclictest9-21ksoftirqd/011:04:210
25273993815,4cyclictest9-21ksoftirqd/009:34:250
106891380,1ptp4l401ktimersoftd/314:37:463
106891380,1ptp4l401ktimersoftd/313:43:253
106891380,1ptp4l401ktimersoftd/313:25:163
106891380,1ptp4l401ktimersoftd/312:53:033
106891380,1ptp4l401ktimersoftd/312:53:033
106891380,1ptp4l401ktimersoftd/312:30:103
106891380,1ptp4l401ktimersoftd/312:25:003
106891380,1ptp4l401ktimersoftd/312:20:133
106891380,1ptp4l401ktimersoftd/311:50:263
106891380,1ptp4l401ktimersoftd/311:26:333
106891380,1ptp4l401ktimersoftd/311:18:323
25291993720,14cyclictest41-21ksoftirqd/309:20:373
25291993710,24cyclictest6199-21sed10:43:583
2529199370,8cyclictest16350-21apt-get11:04:143
2527899372,4cyclictest27634-21apt-get12:24:141
25278993712,21cyclictest2239-21gltestperf13:04:211
25278993710,23cyclictest21336-21fschecks_count11:44:161
2527899370,7cyclictest19707-21awk12:14:321
2527899370,5cyclictest32307-21snmp_o5powerctl09:19:231
2527899370,4cyclictest5834-21ssh12:00:391
2527899370,4cyclictest16594-21ssh12:12:311
2527899370,4cyclictest12049-21ssh13:47:461
2527899370,33cyclictest5631-21/usr/sbin/munin12:34:211
25273993731,3cyclictest9-21ksoftirqd/014:29:230
25273993731,3cyclictest9-21ksoftirqd/014:09:030
25273993731,3cyclictest9-21ksoftirqd/013:49:170
25273993731,3cyclictest9-21ksoftirqd/010:38:580
25273993724,10cyclictest9-21ksoftirqd/012:19:300
25273993716,8cyclictest9-21ksoftirqd/012:39:250
25273993714,4cyclictest9-21ksoftirqd/010:14:280
25273993713,4cyclictest9-21ksoftirqd/011:49:080
25273993713,4cyclictest9-21ksoftirqd/011:20:380
106891370,1ptp4l401ktimersoftd/314:15:313
106891370,1ptp4l401ktimersoftd/312:16:323
106891370,1ptp4l401ktimersoftd/312:12:423
106891370,1ptp4l401ktimersoftd/311:47:183
106891370,0ptp4l401ktimersoftd/313:35:143
79412360,3sleep37939-21cat12:04:013
2529199362,28cyclictest0-21swapper/311:29:103
25291993613,20cyclictest11816-21sed10:54:163
2527899369,23cyclictest3622-21expr13:39:161
2527899361,31cyclictest27209-21cron12:24:001
25278993610,22cyclictest18675-21if_ens313:54:211
25278993610,22cyclictest1658-21fschecks_count11:24:151
25278993610,22cyclictest10734-21fschecks_time09:44:121
2527899360,4cyclictest24576-21ssh12:54:161
2527899360,4cyclictest23747-21sed13:59:221
2527899360,4cyclictest20634-21memory14:29:231
25273993630,3cyclictest9-21ksoftirqd/011:24:150
25273993630,3cyclictest9-21ksoftirqd/010:58:580
25273993628,4cyclictest9-21ksoftirqd/009:24:080
25273993612,4cyclictest9-21ksoftirqd/010:59:200
25273993612,4cyclictest9-21ksoftirqd/010:59:200
106891360,1ptp4l401ktimersoftd/312:45:433
106891360,1ptp4l401ktimersoftd/312:07:053
106891360,1ptp4l401ktimersoftd/310:44:213
106891360,1ptp4l401ktimersoftd/309:15:003
106891360,1ptp4l401ktimersoftd/309:15:003
106891360,1ptp4l401ktimersoftd/309:08:563
106891360,1ptp4l401ktimersoftd/309:08:563
106891360,0ptp4l401ktimersoftd/311:39:093
285962350,4sleep02527399cyclictest10:19:270
25291993510,22cyclictest9757-21cat10:49:213
2527899353,26cyclictest0-21swapper/110:14:101
2527899352,7cyclictest32468-21apt-get12:29:101
2527899352,29cyclictest0-21swapper/113:24:131
25278993511,21cyclictest26324-21sh11:15:221
25278993510,22cyclictest30640-21latency_hist13:34:031
2527899350,4cyclictest7635-21mailstats11:29:221
2527399358,2cyclictest121rcu_preempt12:44:070
2527399357,6cyclictest9-21ksoftirqd/011:14:200
25273993529,3cyclictest9-21ksoftirqd/014:09:150
25273993513,4cyclictest9-21ksoftirqd/013:38:320
106891350,1ptp4l401ktimersoftd/309:34:183
25291993413,18cyclictest7954-21which13:09:263
2529199340,4cyclictest19330-21/usr/sbin/munin11:09:143
2527899348,22cyclictest9311-21cat12:04:221
2527899348,22cyclictest27968-21cstates14:04:171
2527899346,25cyclictest12928-21unixbench_multi11:34:311
2527899343,8cyclictest27009-21apt-get10:19:101
2527899341,30cyclictest14933-21ssh12:44:161
25278993410,21cyclictest20692-21irqrtprio10:04:171
25278993410,20cyclictest1677-21bc10:34:101
2527899340,5cyclictest20682-21ssh13:23:371
2527899340,3cyclictest0-21swapper/114:34:191
2527899340,16cyclictest17185-21sed11:04:211
2527399346,6cyclictest9-21ksoftirqd/010:43:580
25273993429,3cyclictest9-21ksoftirqd/013:59:240
25273993429,3cyclictest9-21ksoftirqd/012:09:160
25273993428,3cyclictest9-21ksoftirqd/013:29:210
25273993427,4cyclictest9-21ksoftirqd/012:54:190
2527399341,3cyclictest9-21ksoftirqd/013:19:190
106891340,1ptp4l401ktimersoftd/314:30:363
106891340,1ptp4l401ktimersoftd/314:10:233
106891340,0ptp4l401ktimersoftd/312:34:363
2527899335,25cyclictest23848-21unixbench_multi10:09:271
2527899333,7cyclictest15123-21apt-get09:54:121
2527899332,26cyclictest0-21swapper/109:14:091
2527899332,26cyclictest0-21swapper/109:14:091
2527899331,28cyclictest5747-21cut09:34:111
25278993311,19cyclictest1703-21switchtime14:09:301
2527899330,5cyclictest18672-21rm11:40:451
2527899330,30cyclictest21556-21rm12:49:511
2527899330,30cyclictest21556-21rm12:49:511
2527899330,30cyclictest14533-21rm13:16:251
25273993328,3cyclictest9-21ksoftirqd/009:44:150
25273993327,3cyclictest9-21ksoftirqd/010:44:150
25273993327,3cyclictest9-21ksoftirqd/009:18:570
25273993327,3cyclictest9-21ksoftirqd/009:18:570
2529199328,21cyclictest3086-21cat09:28:573
2529199322,5cyclictest22240-21apt-get10:09:093
2529199322,26cyclictest0-21swapper/310:29:083
2529199322,25cyclictest0-21swapper/309:44:083
2529199322,23cyclictest0-21swapper/309:49:103
25291993216,13cyclictest41-21ksoftirqd/309:43:133
2529199320,29cyclictest24529-21/usr/sbin/munin10:14:223
2527899327,22cyclictest0-21swapper/111:09:051
2527899322,6cyclictest3274-21apt-get09:29:091
2527899321,5cyclictest30779-21sed12:59:291
2527899320,5cyclictest2388-21ssh11:58:111
25273993226,3cyclictest9-21ksoftirqd/009:39:180
2529199319,19cyclictest17838-21fschecks_time09:59:133
25291993111,17cyclictest14752-21timedrift13:49:313
25291993110,18cyclictest27664-21irqrtprio10:19:173
2527899316,4cyclictest13054-21fschecks_count09:49:131
2527899315,6cyclictest9276-21sed10:49:171
2527899315,3cyclictest8458-21grep09:39:131
2527899315,3cyclictest0-21swapper/109:13:571
2527899315,3cyclictest0-21swapper/109:13:571
2527899312,7cyclictest11378-21apt-get10:54:121
25278993112,16cyclictest18662-21proc_pri09:59:201
25273993125,3cyclictest9-21ksoftirqd/010:04:150
2529199308,19cyclictest14681-21expr10:59:183
2529199308,19cyclictest14681-21expr10:59:183
2529199307,3cyclictest21496-21grep10:04:283
25283993016,8cyclictest0-21swapper/212:44:132
25278993011,16cyclictest7444-21missed_timers10:44:191
2527899300,6cyclictest32191-21grep10:29:121
25273993025,3cyclictest9-21ksoftirqd/009:08:560
2529199291,5cyclictest25874-21ssh12:54:303
2529199291,4cyclictest1787-21grep10:34:123
2529199290,5cyclictest3919-21grep09:29:163
25283992923,3cyclictest33-21ksoftirqd/212:02:112
25283992915,6cyclictest321ktimersoftd/213:49:142
2527899291,4cyclictest14190-21grep10:59:141
2527899291,4cyclictest14190-21grep10:59:141
2528399284,13cyclictest30801-21ssh11:54:112
2529199275,3cyclictest14809-21cron09:53:583
2528399276,11cyclictest16086-21ssh11:39:122
2528399274,5cyclictest1055-21runrttasks12:11:172
25283992721,3cyclictest33-21ksoftirqd/212:58:282
25283992721,3cyclictest33-21ksoftirqd/211:18:472
25283992720,4cyclictest33-21ksoftirqd/211:25:262
25283992720,4cyclictest33-21ksoftirqd/210:25:072
25283992720,4cyclictest33-21ksoftirqd/209:13:562
25283992720,4cyclictest33-21ksoftirqd/209:13:562
2528399264,12cyclictest16495-21ssh13:19:152
25283992621,3cyclictest33-21ksoftirqd/212:59:252
25283992620,3cyclictest33-21ksoftirqd/210:46:032
25283992620,3cyclictest33-21ksoftirqd/209:20:042
25283992619,4cyclictest33-21ksoftirqd/210:30:582
25283992619,4cyclictest33-21ksoftirqd/210:12:592
25283992617,5cyclictest26339-21grep13:29:182
2528399253,3cyclictest121rcu_preempt11:12:142
25283992520,3cyclictest33-21ksoftirqd/213:39:032
25283992520,3cyclictest33-21ksoftirqd/213:19:022
25283992520,3cyclictest33-21ksoftirqd/209:29:472
25283992519,3cyclictest33-21ksoftirqd/212:37:302
25283992518,4cyclictest33-21ksoftirqd/214:11:352
25283992518,4cyclictest33-21ksoftirqd/211:02:052
25283992518,4cyclictest33-21ksoftirqd/211:02:052
25283992518,4cyclictest33-21ksoftirqd/210:18:572
25283992518,4cyclictest33-21ksoftirqd/210:01:392
25283992418,3cyclictest33-21ksoftirqd/210:36:322
25283992418,3cyclictest33-21ksoftirqd/209:41:522
25283992417,4cyclictest33-21ksoftirqd/209:56:452
25283992417,4cyclictest18406-21diskmemload13:56:512
2528399241,19cyclictest14755-21apt-get14:24:162
2528399240,3cyclictest121rcu_preempt14:14:242
238862240,1sleep20-21swapper/211:46:172
25283992318,3cyclictest33-21ksoftirqd/210:07:092
25283992317,3cyclictest33-21ksoftirqd/213:59:392
4452222,6sleep233-21ksoftirqd/211:23:142
2528399228,11cyclictest20750-21sh12:16:182
2528399222,7cyclictest17696-21snmp_o5powerctl11:04:302
25283992217,3cyclictest33-21ksoftirqd/212:19:212
25283992216,3cyclictest33-21ksoftirqd/214:33:302
25283992216,3cyclictest33-21ksoftirqd/213:41:572
25283992215,4cyclictest33-21ksoftirqd/214:04:332
25283992214,4cyclictest10464-21sh14:19:212
25283992210,9cyclictest14248-21turbostat.cron12:44:012
25283992116,3cyclictest33-21ksoftirqd/210:53:582
25283992116,3cyclictest33-21ksoftirqd/210:42:422
25283992115,3cyclictest33-21ksoftirqd/213:13:102
25283992115,3cyclictest33-21ksoftirqd/211:31:322
25283992115,3cyclictest33-21ksoftirqd/210:58:362
25283992115,3cyclictest24814-21grep14:34:212
25283992114,4cyclictest31634-21sh12:28:142
2528399204,10cyclictest10385-21apt-get09:44:092
25283992014,3cyclictest5495-21sh13:07:552
25283992013,4cyclictest28316-21mailstats10:19:222
25283992013,4cyclictest25220-21sh13:28:062
25283992013,4cyclictest21445-21sh12:49:402
25283992013,4cyclictest21445-21sh12:49:402
25283992013,4cyclictest11058-21sh11:34:092
25283992013,4cyclictest10249-21sh13:44:382
25283991913,3cyclictest26976-21missed_timers11:49:222
25283991913,3cyclictest2145-21sh12:29:552
25283991913,3cyclictest12705-21basename09:49:092
25283991913,3cyclictest1137-21cat09:24:102
25283991610,3cyclictest5730-21expr09:34:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional