You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 14:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Fri Jan 09, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
396139900,0EcMasterDemoSyn397129tAtEmLog_007:23:035
1980339850,0EcMasterDemoSyn1981529tAtEmLog_011:11:155
2925639830,0EcMasterDemoSyn2926629tAtEmLog_007:07:505
517239820,0EcMasterDemoSyn518229tAtEmLog_008:34:035
2324239820,0EcMasterDemoSyn2325229tAtEmLog_012:07:025
1413839820,0EcMasterDemoSyn1414829tAtEmLog_012:01:575
1413839820,0EcMasterDemoSyn1414829tAtEmLog_012:01:575
1060439820,0EcMasterDemoSyn1061429tAtEmLog_011:06:115
862839810,0EcMasterDemoSyn863829tAtEmLog_009:55:115
752939810,0EcMasterDemoSyn753929tAtEmLog_008:39:075
2811239810,0EcMasterDemoSyn2812229tAtEmLog_008:13:465
1733539810,0EcMasterDemoSyn1734529tAtEmLog_008:59:255
158039810,0EcMasterDemoSyn159029tAtEmLog_007:18:005
1497839810,0EcMasterDemoSyn1498829tAtEmLog_008:54:205
1126539800,0EcMasterDemoSyn1127529tAtEmLog_007:38:175
3164839310,0EcMasterDemoSyn31654-21ps09:50:070
219792210,0sleep30-21swapper/310:55:133
29525992016,3cyclictest10397-21tail09:55:232
991899190,10tDemoTimingTask10658-21chrt08:45:025
203642190,0sleep20-21swapper/209:43:542
2952099181,13cyclictest16-1pr/legacy11:26:271
2951599180,9cyclictest29921-21sh10:59:470
2951599180,14cyclictest32658-21sh12:12:180
2951599180,14cyclictest21112-21sh11:48:050
2951599180,10cyclictest31034-21sh11:35:180
2951599180,10cyclictest25427-21sh10:39:290
2951599180,10cyclictest2514-21sh10:26:170
632899170,9tDemoTimingTask6332-21chrt07:28:095
492939170,0EcMasterDemoSyn0-21swapper/511:56:535
492939170,0EcMasterDemoSyn0-21swapper/511:56:535
29530991713,3cyclictest21980-21sh09:45:003
2953099170,9cyclictest19976-21sed07:55:173
2952599171,12cyclictest16-1pr/legacy08:59:232
2952599170,10cyclictest23376-21ssh11:13:452
2952099170,9cyclictest12705-21taskset08:49:521
2951599170,9cyclictest831-21runrttasks11:44:480
2951599170,9cyclictest451-21sh11:00:300
2951599170,9cyclictest28163-21runrttasks11:15:460
2951599170,9cyclictest22897-21fschecks_time10:20:120
2951599170,14cyclictest19442-21sh12:23:040
2897599170,10tDemoTimingTask1709-21chrt11:19:565
613099160,9tDemoTimingTask11963-21chrt10:49:565
2953699160,9cyclictest23580-21ssh11:31:094
2953699160,9cyclictest19673-21sh11:47:034
2953699160,9cyclictest15537-21sh11:26:514
2953699160,12cyclictest16-1pr/legacy11:06:104
2953099165,6cyclictest23485-21expr12:25:163
29525991612,3cyclictest24837-21fschecks_count11:50:132
2952599160,12cyclictest16-1pr/legacy08:39:072
2952099165,8cyclictest24577-21runintdemo5min10:20:361
2951599164,8cyclictest2745-21timerwakeupswit11:55:240
2951599164,8cyclictest2745-21timerwakeupswit11:55:240
2951599160,9cyclictest831-21runrttasks08:59:070
2951599160,8cyclictest28552-21sh09:13:050
2951599160,7cyclictest28813-21ssh10:40:300
2951599160,13cyclictest831-21runrttasks08:48:410
2951599160,11cyclictest20104-21ssh09:43:430
2234839160,7EcMasterDemoSyn27060-21chrt09:47:095
2953699155,8cyclictest21737-21/usr/sbin/munin09:05:254
2953699155,8cyclictest1251-21/usr/sbin/munin08:25:144
2953699150,9cyclictest7270-21runrttasks08:35:454
2953699150,9cyclictest3675-21sh11:02:434
2953099155,8cyclictest11886-21/usr/sbin/munin12:00:233
2953099155,8cyclictest11886-21/usr/sbin/munin12:00:233
2953099154,8cyclictest32724-21sed09:50:163
2953099151,9cyclictest16-1pr/legacy11:01:053
2953099151,10cyclictest21647-21sh10:36:503
2953099150,11cyclictest659-21ssh11:19:133
2953099150,11cyclictest3990-21ssh11:38:473
2953099150,11cyclictest3310-21sh11:55:453
2953099150,11cyclictest3310-21sh11:55:453
2953099150,11cyclictest32301-21sh09:32:303
2953099150,11cyclictest30596-21ssh10:24:513
2953099150,11cyclictest21162-21sh11:48:073
2953099150,11cyclictest20901-21sh11:12:013
2953099150,11cyclictest18206-21rm09:25:113
2953099150,11cyclictest13084-21taskset10:15:093
2953099150,10cyclictest6315-21atemtest11:40:123
2953099150,10cyclictest3053-21/usr/sbin/munin07:20:163
2953099150,10cyclictest14115-21/usr/sbin/munin07:45:103
2952599154,8cyclictest744-21snmpd07:24:372
2952599154,8cyclictest639-21processes09:50:192
2952599152,9cyclictest807-21postgres12:13:332
29525991512,2cyclictest0-21swapper/211:45:002
2952599151,10cyclictest831-21runrttasks09:34:172
2952599150,12cyclictest24715-21sh09:45:322
2952599150,11cyclictest5768-21grep11:40:002
2952599150,11cyclictest16279-21ssh12:20:502
2952599150,11cyclictest10954-21ssh12:18:272
2952599150,11cyclictest10731-21wget08:45:112
2952099150,9cyclictest712-21sh10:08:201
2952099150,11cyclictest23153-21runrttasks08:00:281
2952099150,11cyclictest23153-21runrttasks08:00:271
2951599157,6cyclictest19709-21head10:00:220
2951599157,6cyclictest19709-21head10:00:210
2951599156,7cyclictest2836-21sh12:31:180
2951599156,7cyclictest15195-21ssh10:50:510
2951599156,7cyclictest13193-21wget10:15:110
2951599154,8cyclictest760-21lldpd11:09:330
2951599153,9cyclictest831-21runrttasks08:21:330
2951599153,6cyclictest18721-21latency_hist12:05:000
2951599153,6cyclictest18721-21latency_hist12:05:000
2951599150,9cyclictest1282-21timerwakeupswit09:15:220
2951599150,7cyclictest175-1kworker/0:1H+kblockd07:22:020
2951599150,6cyclictest23132-21/usr/sbin/munin12:25:140
86699140,12tDemoTimingTask2007-21chrt11:37:235
2953699144,5cyclictest31930-21cat07:15:004
2953699143,8cyclictest29991-21timerandwakeup08:15:244
2953699143,8cyclictest1356-21uptime07:15:244
2953699143,8cyclictest1280-21tr11:55:134
2953699143,8cyclictest1280-21tr11:55:134
2953699141,9cyclictest9347-21sh10:48:094
2953699141,9cyclictest23760-21sh10:03:104
2953699141,9cyclictest23760-21sh10:03:094
2953699141,9cyclictest10700-21runrttasks09:38:354
29536991410,3cyclictest30294-21gltestperf11:35:134
2953699140,9cyclictest864-21runintdemo5min08:03:394
2953699140,9cyclictest864-21runintdemo5min08:03:394
2953699140,9cyclictest831-21runrttasks08:57:444
2953699140,9cyclictest24181-21sh11:50:034
2953699140,9cyclictest23845-21/usr/sbin/munin08:05:104
2953699140,11cyclictest831-21runrttasks12:32:074
2953699140,10cyclictest831-21runrttasks10:50:064
2953699140,10cyclictest831-21runrttasks10:19:374
2953699140,10cyclictest831-21runrttasks08:30:254
2953699140,10cyclictest8162-21threads07:30:214
2953699140,10cyclictest5506-21timerwakeupswit10:10:244
2953699140,10cyclictest32671-21ssh10:43:104
2953699140,10cyclictest30196-21ssh11:17:094
2953699140,10cyclictest29664-21sh09:13:504
2953699140,10cyclictest28887-21ssh10:59:034
2953699140,10cyclictest25994-21ssh12:26:214
2953699140,10cyclictest19665-21sh11:11:104
2953699140,10cyclictest18386-21ssh12:22:184
2953699140,10cyclictest14115-21/usr/sbin/munin07:45:174
2953699140,10cyclictest13600-21sh11:44:094
2953699140,10cyclictest1341-21ssh10:08:444
2953099144,9cyclictest29510-21cyclictest07:33:523
2953099144,6cyclictest31288-21apt-key10:25:003
2953099141,9cyclictest8408-21ssh10:30:113
2953099141,9cyclictest3849-21ssh10:45:133
2953099141,9cyclictest30634-21latency07:10:173
2953099141,9cyclictest18203-21runrttasks07:51:313
2953099141,9cyclictest10477-21ssh11:06:083
2953099141,10cyclictest13594-21taskset07:42:473
2953099140,9cyclictest3301-21aten2_r5power_p08:30:103
2953099140,10cyclictest9896-21grep09:20:173
2953099140,10cyclictest9459-21ssh10:13:003
2953099140,10cyclictest8657-21wget09:55:113
2953099140,10cyclictest8549-21ssh12:35:073
2953099140,10cyclictest744-21snmpd08:01:203
2953099140,10cyclictest744-21snmpd08:01:203
2953099140,10cyclictest6975-21ssh12:15:413
2953099140,10cyclictest5586-21/usr/sbin/munin08:35:143
2953099140,10cyclictest4453-21/usr/sbin/munin07:25:213
2953099140,10cyclictest4399-21ssh11:20:273
2953099140,10cyclictest3936-21ssh09:35:023
2953099140,10cyclictest3711-21ssh12:31:563
2953099140,10cyclictest32711-21hddtemp_smartct09:15:143
2953099140,10cyclictest31937-21sh10:42:393
2953099140,10cyclictest30078-21ssh12:10:283
2953099140,10cyclictest29695-21sh09:13:503
2953099140,10cyclictest29219-21hddtemp_smartct08:15:153
2953099140,10cyclictest28030-21chrt08:12:473
2953099140,10cyclictest27755-21diskstats10:05:273
2953099140,10cyclictest26945-21ssh11:50:513
2953099140,10cyclictest24926-21ssh09:45:413
2953099140,10cyclictest20793-21idleruntime09:05:163
2953099140,10cyclictest20574-21apt-get11:30:113
2953099140,10cyclictest19158-21cpu12:05:113
2953099140,10cyclictest18182-21chrt12:22:123
2953099140,10cyclictest18091-21cpuspeed_turbos10:00:113
2953099140,10cyclictest18091-21cpuspeed_turbos10:00:113
2953099140,10cyclictest16001-21gltestperf08:55:153
2953099140,10cyclictest1546-21hddtemp_smartct08:25:163
2953099140,10cyclictest15287-21cat08:55:013
2953099140,10cyclictest12551-21rm10:50:083
2953099140,10cyclictest12387-21irqstats11:25:173
2953099140,10cyclictest11766-21/usr/sbin/munin08:45:173
2953099140,10cyclictest11610-21latency_hist07:40:003
2953099140,10cyclictest10033-21http08:45:013
2952599145,7cyclictest17193-21/usr/sbin/munin07:50:162
2952599145,5cyclictest24238-21/usr/sbin/munin12:25:222
2952599141,9cyclictest831-21runrttasks11:01:292
2952599141,9cyclictest808-21postgres10:16:292
2952599141,9cyclictest4674-21seq11:20:392
2952599141,9cyclictest26224-21runrttasks10:04:522
2952599141,9cyclictest26224-21runrttasks10:04:522
2952599141,9cyclictest17520-21diskmemload10:35:082
29525991411,2cyclictest0-21swapper/209:15:162
2952599141,10cyclictest14862-21ssh10:50:372
2952599140,11cyclictest864-21runintdemo5min10:05:202
2952599140,11cyclictest6899-21ssh10:11:122
2952599140,11cyclictest5375-21ls07:25:182
2952599140,11cyclictest27959-21ntp_offset10:40:182
2952599140,10cyclictest9516-21ssh11:05:282
2952599140,10cyclictest9156-21taskset07:35:082
2952599140,10cyclictest9057-21awk08:40:192
2952599140,10cyclictest8772-21ssh09:20:072
2952599140,10cyclictest8537-21ssh12:35:062
2952599140,10cyclictest831-21runrttasks08:51:212
2952599140,10cyclictest831-21runrttasks08:05:042
2952599140,10cyclictest5254-21grep10:45:232
2952599140,10cyclictest32599-21fschecks_time07:15:132
2952599140,10cyclictest32288-21perl10:25:142
2952599140,10cyclictest3036-21sh11:55:292
2952599140,10cyclictest3036-21sh11:55:292
2952599140,10cyclictest29822-21chrt08:15:222
2952599140,10cyclictest29457-21ssh11:16:392
2952599140,10cyclictest27440-21ssh10:22:352
2952599140,10cyclictest26438-21ssh09:11:362
2952599140,10cyclictest26199-21/usr/sbin/munin08:10:122
2952599140,10cyclictest22975-21ssh09:27:212
2952599140,10cyclictest22902-21cat08:00:232
2952599140,10cyclictest22902-21cat08:00:232
2952599140,10cyclictest22080-21ssh10:55:132
2952599140,10cyclictest20444-21diskmemload11:30:062
2952599140,10cyclictest20161-21wget09:05:112
2952599140,10cyclictest19760-21rm11:47:072
2952599140,10cyclictest19607-21fschecks_time12:05:142
2952599140,10cyclictest19448-21cut07:55:132
2952599140,10cyclictest18819-21ntp_offset09:00:182
2952599140,10cyclictest15420-21sh10:33:522
2952599140,10cyclictest14258-21ssh12:02:012
2952599140,10cyclictest14258-21ssh12:02:012
2952599140,10cyclictest14115-21/usr/sbin/munin07:45:152
2952599140,10cyclictest13362-21grep07:40:252
2952599140,10cyclictest12955-21cat09:39:592
2952599140,10cyclictest11402-21ssh11:25:062
2952599140,10cyclictest1117-21python312:30:222
2952099146,6cyclictest9121-21tune2fs12:35:131
2952099145,8cyclictest6848-21/usr/sbin/munin08:35:201
2952099143,8cyclictest4305-21interrupts10:45:161
2952099141,9cyclictest831-21runrttasks11:41:431
2952099141,9cyclictest831-21runrttasks10:28:091
2952099141,9cyclictest28375-21sh11:51:511
2952099141,9cyclictest19563-21diskmemload10:18:301
2952099141,9cyclictest18646-21ssh11:10:271
2952099141,10cyclictest21313-21ssh10:36:361
2952099141,10cyclictest16-1pr/legacy12:27:191
2952099141,10cyclictest16-1pr/legacy08:54:191
2952099141,10cyclictest16-1pr/legacy08:08:411
2952099140,9cyclictest14885-21sh09:58:241
2952099140,9cyclictest14139-21runrttasks11:08:381
2952099140,11cyclictest6619-21ssh09:18:531
2952099140,10cyclictest7630-21ssh12:16:091
2952099140,10cyclictest6808-21/usr/sbin/munin07:30:231
2952099140,10cyclictest6801-21ssh11:22:071
2952099140,10cyclictest6754-21runrttasks11:04:531
2952099140,10cyclictest6450-21sh10:10:541
2952099140,10cyclictest508-21sh11:36:241
2952099140,10cyclictest4397-21ssh09:52:321
2952099140,10cyclictest3899-21ssh11:56:111
2952099140,10cyclictest3899-21ssh11:56:101
2952099140,10cyclictest30047-21ssh09:14:051
2952099140,10cyclictest27924-21chrt08:11:211
2952099140,10cyclictest25718-21/usr/sbin/munin11:15:141
2952099140,10cyclictest24134-21ssh10:55:451
2952099140,10cyclictest21802-21taskset09:06:031
2952099140,10cyclictest20782-21ssh10:01:061
2952099140,10cyclictest20782-21ssh10:01:061
2952099140,10cyclictest19753-21hddtemp_smartct12:05:151
2952099140,10cyclictest19238-21wget07:55:121
2952099140,10cyclictest18177-21ssh09:25:101
2952099140,10cyclictest16467-21/usr/sbin/munin07:50:191
2952099140,10cyclictest13705-21/usr/sbin/munin12:20:111
2952099140,10cyclictest12085-21rm12:00:301
2952099140,10cyclictest12085-21rm12:00:301
2952099140,10cyclictest10502-21ssh10:30:301
2951599145,8cyclictest5189-21/usr/sbin/munin07:25:160
2951599145,7cyclictest19960-21wc12:05:160
2951599141,9cyclictest4554-21/usr/sbin/munin09:35:130
2951599141,10cyclictest10017-21latency_hist08:45:000
2951599140,8cyclictest25205-21runrttasks11:50:150
2951599140,7cyclictest26727-21perl08:10:140
2951599140,7cyclictest23444-21sh09:27:410
2951599140,7cyclictest12973-21python311:25:200
2951599140,6cyclictest19765-21runintdemo5min11:11:140
2951599140,12cyclictest4497-21ssh11:20:310
2951599140,12cyclictest4125-21grep10:45:150
2951599140,12cyclictest3553-21sh10:10:040
2951599140,12cyclictest13619-21ssh09:57:310
2951599140,12cyclictest11456-21sh10:31:060
2951599140,11cyclictest11151-21runrttasks07:36:490
2951599140,10cyclictest8578-21sh12:35:080
2951599140,10cyclictest7658-21taskset08:40:010
2951599140,10cyclictest29684-21sh09:30:410
2951599140,10cyclictest26914-21ssh10:05:090
2951599140,10cyclictest25102-21taskset08:05:190
2951599140,10cyclictest24316-21sh11:31:380
2951599140,10cyclictest16488-21sh09:24:140
2951599140,10cyclictest11708-21sh12:18:580
2953699137,3cyclictest151239EcMasterDemoSyn10:25:374
2953699131,9cyclictest14280-21python308:50:204
2953699131,7cyclictest14762-21sendmail_mailst09:40:204
2953699130,9cyclictest9250-21tr07:35:124
2953699130,9cyclictest8205-21ssh10:30:034
2953699130,9cyclictest7964-21/usr/sbin/munin08:40:204
2953699130,9cyclictest744-21snmpd09:15:524
2953699130,9cyclictest4453-21/usr/sbin/munin07:25:204
2953699130,9cyclictest4107-21runrttasks07:24:314
2953699130,9cyclictest28864-21rm09:30:244
2953699130,9cyclictest28031-21/usr/sbin/munin12:10:114
2953699130,9cyclictest26199-21/usr/sbin/munin08:10:114
2953699130,9cyclictest24489-21grep10:20:334
2953699130,9cyclictest2385-21munin-node11:20:104
2953699130,9cyclictest19687-21taskset09:04:164
2953699130,9cyclictest19437-21fschecks_count12:05:144
2953699130,9cyclictest19123-21/usr/sbin/munin07:55:214
2953699130,9cyclictest14678-21sh09:23:014
2953699130,9cyclictest12528-21ssh12:00:494
2953699130,9cyclictest12528-21ssh12:00:494
2953699130,9cyclictest10489-21apt-key08:45:004
2953699130,9cyclictest10473-21sh09:55:234
2953699130,10cyclictest9584-21ssh12:35:164
2953699130,10cyclictest7983-21sh12:16:254
2953699130,10cyclictest3451-21ssh09:51:534
2953699130,10cyclictest23274-21grep09:45:134
2953699130,10cyclictest20775-21runrttasks09:25:494
2953699130,10cyclictest18301-21taskset07:52:514
2953699130,10cyclictest18116-21fschecks_time10:35:134
2953699130,10cyclictest11993-21tr07:40:124
2953099130,9cyclictest32505-21forks07:15:133
2953099130,9cyclictest17919-21cpuspeed09:00:123
2953099130,10cyclictest31426-21fschecks_time08:20:143
2952599135,6cyclictest31438-21fschecks_time08:20:142
2952599130,9cyclictest6808-21/usr/sbin/munin07:30:112
2952599130,10cyclictest4487-21python308:30:192
2952599130,10cyclictest31482-21chrt07:11:022
2952599130,10cyclictest2134-21runrttasks08:25:212
2952099135,6cyclictest4305-21ntpq08:30:181
2952099135,6cyclictest10081-21ntpq09:20:171
2952099130,9cyclictest831-21runrttasks08:57:111
2952099130,9cyclictest831-21runrttasks08:25:421
2952099130,9cyclictest831-21runrttasks07:36:051
2952099130,9cyclictest791-21latency_hist08:25:011
2952099130,9cyclictest6504-21sh09:35:431
2952099130,9cyclictest6179-21postgres07:26:211
2952099130,9cyclictest32349-21cpuspeed_turbos07:15:111
2952099130,9cyclictest31765-21chrt07:14:141
2952099130,9cyclictest31683-21ssh12:30:011
2952099130,9cyclictest3157-21ntp_kernel_pll_07:20:171
2952099130,9cyclictest28960-21cat09:30:251
2952099130,9cyclictest28552-21/usr/sbin/munin08:15:221
2952099130,9cyclictest28031-21/usr/sbin/munin12:10:181
2952099130,9cyclictest26737-21/usr/sbin/munin10:40:171
2952099130,9cyclictest22521-21/usr/sbin/munin09:45:181
2952099130,9cyclictest17749-21/usr/sbin/munin09:00:241
2952099130,9cyclictest15101-21sh11:45:011
2952099130,9cyclictest13389-21/usr/sbin/munin09:40:131
2952099130,9cyclictest12646-21/usr/sbin/munin10:50:201
2952099130,10cyclictest8955-21tail08:40:171
2952099130,10cyclictest831-21runrttasks07:45:031
2952099130,10cyclictest808-21postgres07:41:221
2952099130,10cyclictest21764-21ssh11:30:181
2951599136,5cyclictest2055-21grep08:25:200
2951599131,10cyclictest29712-21cat07:10:000
2951599130,9cyclictest831-21runrttasks07:32:080
2951599130,9cyclictest831-21runrttasks07:10:290
2951599130,9cyclictest21660-21awk08:00:120
2951599130,9cyclictest21660-21awk08:00:110
2951599130,9cyclictest17631-21/usr/sbin/munin07:50:190
2951599130,9cyclictest12519-21irqstats07:40:150
2951599130,7cyclictest175-1kworker/0:1H+kblockd09:00:070
2951599130,7cyclictest175-1kworker/0:1H+kblockd07:15:180
2951599130,11cyclictest22417-21ssh09:45:050
2951599130,10cyclictest831-21runrttasks08:30:330
2951599130,10cyclictest29287-21/usr/sbin/munin08:15:150
2951599130,10cyclictest20262-21/usr/sbin/munin09:05:120
2951599130,10cyclictest18520-21apt-get07:55:020
2951599130,10cyclictest13731-21if_enp5s008:50:140
2812229130,2tAtEmLog_030217-21chrt08:15:265
2102599130,11tDemoTimingTask21107-21chrt07:59:175
781029120,2tAtEmLog_015184-21chrt09:23:225
575799120,9tDemoTimingTask14075-21chrt11:25:505
3049199120,10tDemoTimingTask32193-21chrt08:20:205
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional