You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 14:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Dec 29, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11520391510,1EcMasterDemoSyn11518-21ssh10:12:352
11520391510,1EcMasterDemoSyn11518-21ssh10:12:342
21379391310,1EcMasterDemoSyn21387-21runintdemo5min09:01:353
3006639950,0EcMasterDemoSyn3007729tAtEmLog_010:58:125
2564939910,0EcMasterDemoSyn2565929tAtEmLog_010:37:565
1105439840,0EcMasterDemoSyn1106429tAtEmLog_009:37:045
2476539830,0EcMasterDemoSyn2477529tAtEmLog_008:00:445
193639830,0EcMasterDemoSyn194629tAtEmLog_011:18:305
1664539830,0EcMasterDemoSyn1665529tAtEmLog_008:51:265
687239820,0EcMasterDemoSyn688229tAtEmLog_010:27:475
2936439820,0EcMasterDemoSyn2937429tAtEmLog_011:33:435
2519839820,0EcMasterDemoSyn2520829tAtEmLog_011:13:255
212239820,0EcMasterDemoSyn213229tAtEmLog_008:21:015
1900039820,0EcMasterDemoSyn1901029tAtEmLog_008:56:305
975339810,0EcMasterDemoSyn976329tAtEmLog_007:30:195
2281439810,0EcMasterDemoSyn2282429tAtEmLog_012:24:255
2025139810,0EcMasterDemoSyn2026129tAtEmLog_011:28:385
398639800,0EcMasterDemoSyn399629tAtEmLog_007:20:105
975339620,0EcMasterDemoSyn9762-21runintdemo5min07:30:183
2091039580,4EcMasterDemoSyn20918-21grep10:53:083
1152039540,5EcMasterDemoSyn11525-21runintdemo5min10:12:354
1152039540,5EcMasterDemoSyn11525-21runintdemo5min10:12:344
1509939500,1EcMasterDemoSyn15108-21runintdemo5min07:40:273
3139599191,13cyclictest16-1pr/legacy09:26:561
249199190,11tDemoTimingTask5684-21chrt10:45:015
3139599181,13cyclictest16-1pr/legacy09:37:031
3139099180,14cyclictest19540-21sh09:41:330
3139099180,14cyclictest18098-21sh11:09:460
3139099180,10cyclictest6075-21sh11:38:480
3139099180,10cyclictest25483-21sh11:49:460
3139099180,10cyclictest2231-21sh12:30:220
3139099180,10cyclictest21285-21sh10:35:170
684899170,10tDemoTimingTask7455-21taskset08:35:015
3140099179,6cyclictest7045-21grep12:15:173
3140099170,10cyclictest22365-21runrttasks09:25:283
3139999178,7cyclictest30012-21tr10:05:132
3139099170,9cyclictest8438-21ssh11:04:220
3139099170,9cyclictest31630-21unixbench_multi12:10:250
3139099170,9cyclictest27572-21ssh10:03:570
3139099170,9cyclictest12399-21ssh09:37:580
3139099170,9cyclictest10270-21apt-config10:30:010
3139099170,8cyclictest831-21runrttasks11:29:260
161329170,7tAtEmLog_03538-21chrt07:18:365
158039170,0EcMasterDemoSyn0-21swapper/509:32:005
31400991612,3cyclictest5024-21cpuspeed_turbos11:20:133
3140099160,14cyclictest9132-21munin-plugin-st12:35:013
3139999162,10cyclictest11157-21needreboot08:40:202
3139999160,9cyclictest14816-21ssh12:01:052
3139999160,9cyclictest11288-21sh09:37:132
3139599165,6cyclictest21444-21cut12:05:151
3139599165,6cyclictest21444-21cut12:05:141
3139099165,8cyclictest14047-21kworker/u24:0+rpciod12:26:560
3139099164,9cyclictest744-21snmpd11:12:520
3139099160,9cyclictest831-21runrttasks08:57:210
3139099160,9cyclictest831-21runrttasks07:53:060
2429499160,9tDemoTimingTask25702-21chrt11:49:555
1771499160,9tDemoTimingTask17813-21chrt12:39:425
840199151,8tDemoTimingTask8425-21taskset12:34:355
667629150,4tAtEmLog_0137312sleep509:55:475
3140199154,8cyclictest744-21snmpd09:06:034
3140199153,7cyclictest9164-21kworker/u24:2+nfsiod11:33:464
31401991511,3cyclictest18120-21gltestperf11:45:144
31401991511,3cyclictest1607-21runintdemo5min07:15:054
3140199151,10cyclictest31605-21cat07:10:004
3140199150,9cyclictest9914-21ssh10:29:504
3140199150,11cyclictest23951-21wc08:00:174
3140099151,10cyclictest831-21runrttasks10:59:163
3139999158,5cyclictest18384-21wget07:50:112
3139999154,8cyclictest3449-21grep09:50:202
3139999152,9cyclictest16932-21sh09:23:052
3139999151,10cyclictest26415-21/usr/sbin/munin11:50:182
3139999150,9cyclictest5450-21sh12:14:462
3139999150,9cyclictest18522-21sh12:21:192
3139999150,8cyclictest28070-21ssh10:04:182
3139599157,6cyclictest14172-21grep08:45:231
3139599154,8cyclictest24641-21unixbench_multi08:00:231
3139599151,11cyclictest16-1pr/legacy09:31:591
3139599150,9cyclictest31979-21runrttasks08:17:121
3139599150,13cyclictest1985-21df09:15:141
3139599150,11cyclictest5951-21open_inodes11:20:201
3139599150,10cyclictest5118-21/usr/sbin/munin08:30:151
3139599150,10cyclictest11974-21sh12:00:131
3139099155,8cyclictest2028-21ssh10:42:430
3139099150,9cyclictest11672-21sh12:17:500
3139099150,7cyclictest4581-21kworker/u24:0+events_unbound07:15:180
3139099150,13cyclictest1975-21ssh09:32:140
3139099150,12cyclictest831-21runrttasks08:38:130
2899229150,5tAtEmLog_0293332sleep507:05:105
2535099150,9tDemoTimingTask25442-21taskset10:02:305
3140199144,7cyclictest327-21systemd-journal10:23:144
3140199143,8cyclictest22326-21unixbench_singl07:55:254
3140199143,8cyclictest12070-21head07:35:174
3140199142,8cyclictest8223-21unixbench_multi12:15:274
3140199141,9cyclictest15326-21/usr/sbin/munin12:20:254
3140199141,10cyclictest451-21sh11:17:294
3140199140,9cyclictest4015-21python308:25:224
3140199140,12cyclictest9407-21ssh09:54:074
3140199140,10cyclictest9793-21ssh11:05:054
3140199140,10cyclictest7469-21/usr/sbin/munin08:35:144
3140199140,10cyclictest6330-21/usr/sbin/munin07:25:194
3140199140,10cyclictest5067-21sh11:55:364
3140199140,10cyclictest3871-21sh11:37:144
3140199140,10cyclictest26682-21ssh09:45:234
3140199140,10cyclictest24371-21rm09:10:014
3140199140,10cyclictest24176-21ssh10:55:124
3140199140,10cyclictest20100-21/usr/sbin/munin10:35:184
3140199140,10cyclictest19061-21sh11:27:484
3140199140,10cyclictest17951-21sh09:23:464
3140199140,10cyclictest16724-21ssh10:33:004
3140199140,10cyclictest16435-21ssh09:40:154
3140099147,5cyclictest18894-21ssh09:59:203
3140099145,8cyclictest7727-21/usr/sbin/munin10:45:243
3140099143,6cyclictest9906-21postgres11:59:013
3140099141,9cyclictest588-21diskmemload12:11:203
3140099141,9cyclictest25891-21latency_hist11:50:003
3140099141,9cyclictest15385-21sh10:15:013
3140099141,10cyclictest16-1pr/legacy10:07:293
3140099140,9cyclictest6854-21runintdemo5min08:31:103
3140099140,12cyclictest19047-21ssh09:41:113
3140099140,10cyclictest9901-21sh11:05:093
3140099140,10cyclictest8631-21rm09:18:513
3140099140,10cyclictest831-21runrttasks11:51:223
3140099140,10cyclictest831-21runrttasks11:00:253
3140099140,10cyclictest808-21postgres10:23:563
3140099140,10cyclictest7469-21/usr/sbin/munin08:35:153
3140099140,10cyclictest7227-21cat10:10:173
3140099140,10cyclictest7227-21cat10:10:163
3140099140,10cyclictest5027-21latency_hist08:30:003
3140099140,10cyclictest4783-21sh11:37:533
3140099140,10cyclictest32687-21sh10:41:283
3140099140,10cyclictest31507-21date07:10:003
3140099140,10cyclictest31427-21date11:35:003
3140099140,10cyclictest31423-21ssh09:13:393
3140099140,10cyclictest31287-21switchtime09:30:253
3140099140,10cyclictest30478-21ssh09:47:413
3140099140,10cyclictest28014-21ssh11:15:103
3140099140,10cyclictest27914-21sh10:04:113
3140099140,10cyclictest26601-21sh10:38:343
3140099140,10cyclictest21188-21tr12:05:133
3140099140,10cyclictest21188-21tr12:05:123
3140099140,10cyclictest18790-21rm11:10:043
3140099140,10cyclictest18679-21sh12:21:253
3140099140,10cyclictest17257-21/usr/sbin/munin08:55:213
3140099140,10cyclictest16444-21sh09:22:453
3140099140,10cyclictest15998-21/usr/sbin/munin07:45:203
3140099140,10cyclictest15304-21sh12:37:543
3140099140,10cyclictest13791-21/usr/sbin/munin11:25:153
3140099140,10cyclictest12437-21sh11:41:533
3140099140,10cyclictest11779-21ssh12:00:053
3139999143,8cyclictest17356-21xargs07:45:242
3139999143,8cyclictest10682-21smartctl11:05:142
3139999141,9cyclictest831-21runrttasks11:24:042
3139999141,9cyclictest6289-21ssh11:56:272
3139999141,9cyclictest16704-21runrttasks08:51:422
3139999140,10cyclictest9968-21/usr/sbin/munin12:35:202
3139999140,10cyclictest9747-21sh12:16:272
3139999140,10cyclictest7313-21diskmemload11:03:352
3139999140,10cyclictest6469-21sh11:39:042
3139999140,10cyclictest623-21cpuspeed_turbos08:20:132
3139999140,10cyclictest5902-21/usr/sbin/munin10:45:192
3139999140,10cyclictest3728-21grep08:25:192
3139999140,10cyclictest32546-21sh10:41:212
3139999140,10cyclictest31959-21ssh09:14:012
3139999140,10cyclictest3127-21sh12:30:452
3139999140,10cyclictest31081-21ssh11:34:542
3139999140,10cyclictest304-21sh11:17:232
3139999140,10cyclictest29515-21ssh09:30:052
3139999140,10cyclictest27499-21sh10:20:552
3139999140,10cyclictest26725-21ssh09:45:242
3139999140,10cyclictest23921-21diskmemload10:55:032
3139999140,10cyclictest23473-21ssh09:26:122
3139999140,10cyclictest2345-21runrttasks10:25:172
3139999140,10cyclictest22586-21sed12:05:242
3139999140,10cyclictest22586-21sed12:05:232
3139999140,10cyclictest21563-21rm10:35:202
3139999140,10cyclictest21346-21taskset09:01:162
3139999140,10cyclictest20792-21/usr/sbin/munin11:10:242
3139999140,10cyclictest19347-21sh09:41:242
3139999140,10cyclictest19053-21sh10:51:502
3139999140,10cyclictest16651-21ssh10:32:592
3139999140,10cyclictest1642-21ssh09:15:142
3139999140,10cyclictest14666-21cut11:25:192
3139999140,10cyclictest13029-21chrt07:36:122
3139999140,10cyclictest11012-21ssh11:40:532
3139599143,8cyclictest754-21ntpd08:40:221
3139599142,9cyclictest28752-21rm12:27:171
3139599142,9cyclictest16380-21awk10:50:171
3139599141,9cyclictest7840-21sh11:57:331
3139599141,9cyclictest29546-21sh10:22:211
3139599141,9cyclictest25183-21/usr/sbin/munin09:45:181
3139599141,9cyclictest2456-21runrttasks12:12:401
3139599141,9cyclictest18552-21sh12:21:201
3139599141,9cyclictest17772-21diskmemload11:26:531
3139599141,9cyclictest13074-21sh09:55:251
3139599141,9cyclictest11666-21gltestperf07:35:141
3139599141,9cyclictest10730-21runrttasks07:34:221
31395991410,3cyclictest32080-21cpuspeed_turbos11:35:141
3139599140,9cyclictest15701-21latency_hist07:45:001
3139599140,12cyclictest23440-21sed09:05:241
3139599140,10cyclictest8392-21ssh11:40:121
3139599140,10cyclictest831-21runrttasks10:46:531
3139599140,10cyclictest831-21runrttasks09:50:311
3139599140,10cyclictest8258-21ssh10:28:431
3139599140,10cyclictest688-21/usr/sbin/munin12:30:181
3139599140,10cyclictest6574-21cpuspeed_turbos07:25:151
3139599140,10cyclictest3760-21cat07:20:001
3139599140,10cyclictest29270-21/usr/sbin/munin10:40:201
3139599140,10cyclictest27782-21/usr/sbin/munin08:10:251
3139599140,10cyclictest2700-21latency_hist08:25:011
3139599140,10cyclictest26251-21sh11:50:071
3139599140,10cyclictest24988-21rm10:37:281
3139599140,10cyclictest24971-21ssh10:02:111
3139599140,10cyclictest24952-21sh11:13:161
3139599140,10cyclictest22780-21/usr/sbin/munin11:30:201
3139599140,10cyclictest20701-21/usr/sbin/munin07:55:191
3139599140,10cyclictest20633-21ssh09:42:161
3139599140,10cyclictest18770-21ssh10:34:281
3139599140,10cyclictest18689-21/usr/sbin/munin11:45:181
3139599140,10cyclictest15998-21/usr/sbin/munin07:45:191
3139599140,10cyclictest1462-21tune2fs11:00:171
3139599140,10cyclictest12282-21proc_pri09:20:191
3139599140,10cyclictest11454-21python312:35:231
3139599140,10cyclictest10695-21ssh11:05:151
3139599140,10cyclictest10002-21sh10:11:311
3139599140,10cyclictest10002-21sh10:11:311
3139099146,6cyclictest21942-21sensors07:55:200
3139099145,7cyclictest831-21runrttasks08:43:400
3139099145,7cyclictest4047-21ssh11:55:170
3139099145,7cyclictest30296-21ssh10:58:210
3139099141,9cyclictest21082-21runrttasks12:23:090
3139099141,7cyclictest23430-21/usr/sbin/munin08:00:130
3139099141,11cyclictest6479-21perl10:45:140
3139099140,8cyclictest175-1kworker/0:1H+kblockd08:20:360
3139099140,8cyclictest15667-21cut10:15:130
3139099140,8cyclictest15373-21sh10:32:060
3139099140,8cyclictest10404-21grep11:40:270
3139099140,7cyclictest6840-21/usr/sbin/munin10:10:140
3139099140,7cyclictest6840-21/usr/sbin/munin10:10:140
3139099140,7cyclictest6075-21tr11:20:210
3139099140,7cyclictest24101-21cat09:10:000
3139099140,7cyclictest15534-21fschecks_count10:50:120
3139099140,12cyclictest30966-21processes10:05:200
3139099140,12cyclictest29174-21sh11:51:030
3139099140,12cyclictest26798-21cat09:45:240
3139099140,12cyclictest23120-21grep11:30:130
3139099140,12cyclictest20855-21taskset12:05:110
3139099140,12cyclictest20855-21taskset12:05:100
3139099140,10cyclictest8924-21tr07:30:130
3139099140,10cyclictest831-21runrttasks09:26:410
3139099140,10cyclictest31435-21ssh10:23:380
3139099140,10cyclictest31056-21rm11:16:100
3139099140,10cyclictest28816-21rm09:11:550
3139099140,10cyclictest15798-21ssh12:01:490
3139099140,10cyclictest14304-21ssh09:21:200
3139099140,10cyclictest13523-21sh09:55:380
2937599140,5tDemoTimingTask2091-21chrt11:35:585
2139099140,8tDemoTimingTask21394-21taskset09:01:355
1646439140,1EcMasterDemoSyn651irq_work/510:32:515
1378099140,8tDemoTimingTask14618-21taskset12:19:565
1245929140,12tAtEmLog_013258-21chrt07:39:215
559029130,3tAtEmLog_07745-21chrt09:18:145
472029130,2tAtEmLog_047842sleep512:14:185
3140199131,9cyclictest27105-21runrttasks08:05:434
3140199130,9cyclictest9873-21sh11:22:404
3140199130,9cyclictest890-21/usr/sbin/munin11:00:164
3140199130,9cyclictest8683-21/usr/sbin/munin07:30:244
3140199130,9cyclictest831-21runrttasks08:55:084
3140199130,9cyclictest799-21sh12:30:134
3140199130,9cyclictest744-21snmpd08:22:284
3140199130,9cyclictest6668-21hddtemp_smartct10:45:154
3140199130,9cyclictest5668-21users07:20:264
3140199130,9cyclictest5595-21fschecks_time08:30:174
3140199130,9cyclictest30158-21cpuspeed_turbos12:10:134
3140199130,9cyclictest30132-21/usr/sbin/munin08:15:184
3140199130,9cyclictest29690-21/usr/sbin/munin09:30:154
3140199130,9cyclictest29643-21/usr/sbin/munin10:05:254
3140199130,9cyclictest29023-21runrttasks10:40:024
3140199130,9cyclictest28487-21diskmemload11:50:324
3140199130,9cyclictest27782-21/usr/sbin/munin08:10:174
3140199130,9cyclictest24623-21sh12:06:444
3140199130,9cyclictest24623-21sh12:06:444
3140199130,9cyclictest24451-21cpuspeed_turbos12:25:114
3140199130,9cyclictest22697-21sh09:25:414
3140199130,9cyclictest18985-21/usr/sbin/munin11:10:184
3140199130,9cyclictest18350-21/usr/sbin/munin07:50:124
3140199130,9cyclictest15627-21/usr/sbin/munin10:15:234
3140199130,9cyclictest15386-21taskset07:40:514
3140199130,9cyclictest15106-21cpuspeed08:50:144
3140199130,9cyclictest14891-21diskmemload10:50:044
3140199130,9cyclictest14025-21ssh12:00:324
3140199130,9cyclictest12549-21/usr/sbin/munin08:45:124
3140199130,9cyclictest11868-21fschecks_time09:55:144
3140199130,9cyclictest11335-21diskmemload11:41:064
3140199130,9cyclictest10976-21expr12:35:174
3140199130,9cyclictest10905-21sh09:36:594
3140199130,10cyclictest3631-21sh09:15:294
3140199130,10cyclictest32020-21tr07:10:134
3140199130,10cyclictest22833-21ssh10:00:414
3140199130,10cyclictest19628-21/usr/sbin/munin09:00:174
3140199130,10cyclictest16358-21df_inode07:45:144
3140099135,6cyclictest31203-21ntpq08:15:203
3140099131,9cyclictest1401-21diskmemload10:25:063
3140099130,9cyclictest831-21runrttasks12:25:273
3140099130,9cyclictest6409-21sh09:35:043
3140099130,9cyclictest6371-21tr07:25:133
3140099130,9cyclictest4197-21cpuspeed07:20:133
3140099130,9cyclictest27785-21apt-get08:10:133
3140099130,9cyclictest25426-21/usr/sbin/munin08:05:153
3140099130,9cyclictest24837-21taskset08:01:113
3140099130,9cyclictest21997-21aten2_r5power_c09:05:123
3140099130,9cyclictest1963-21sh09:50:093
3140099130,9cyclictest19135-21cut07:50:163
3140099130,9cyclictest14905-21/usr/sbin/munin08:50:143
3140099130,9cyclictest12549-21/usr/sbin/munin08:45:123
3140099130,9cyclictest10863-21ssh10:30:063
3140099130,10cyclictest744-21snmpd08:21:193
3140099130,10cyclictest744-21snmpd07:35:473
3140099130,10cyclictest2583-21cat07:15:193
3140099130,10cyclictest21255-21perl07:55:163
3140099130,10cyclictest12188-21runrttasks08:44:203
3139999131,9cyclictest10500-21runrttasks07:31:132
3139999130,9cyclictest9247-21runintdemo5min08:36:142
3139999130,9cyclictest831-21runrttasks08:48:392
3139999130,9cyclictest8041-21runrttasks07:25:332
3139999130,9cyclictest3974-21runrttasks07:20:082
3139999130,9cyclictest32088-21runrttasks08:18:412
3139999130,9cyclictest28028-21cpuspeed_turbos08:10:152
3139999130,9cyclictest25429-21apt-get08:05:122
3139999130,9cyclictest24857-21chrt08:01:282
3139999130,9cyclictest24019-21sh12:25:032
3139999130,9cyclictest21978-21/usr/sbin/munin09:05:142
3139999130,9cyclictest20696-21runrttasks07:55:072
3139999130,9cyclictest19627-21sh11:45:362
3139999130,9cyclictest17257-21/usr/sbin/munin08:55:262
3139999130,9cyclictest1650-21runrttasks07:15:112
3139999130,9cyclictest15780-21ssh10:15:142
3139999130,10cyclictest744-21snmpd07:44:252
3139999130,10cyclictest6554-21/usr/sbin/munin08:30:262
3139999130,10cyclictest1189-21chrt07:13:382
3139999130,10cyclictest11022-21ssh09:55:022
3139599135,6cyclictest26341-21missed_timers08:05:181
3139599131,9cyclictest24449-21sh10:55:161
3139599130,9cyclictest7536-21aten2_r5power_p08:35:131
3139599130,9cyclictest5393-21timerandwakeup07:20:251
3139599130,9cyclictest3457-21basename08:25:181
3139599130,9cyclictest31270-21ssh10:05:231
3139599130,9cyclictest28177-21grep11:15:111
3139599130,9cyclictest24830-21cpuspeed09:10:131
3139599130,9cyclictest19626-21runrttasks09:00:101
3139599130,9cyclictest17269-21aten2_r5power_c08:55:131
3139599130,9cyclictest16325-21gltestperf10:15:161
3139599130,9cyclictest15070-21cpu08:50:121
3139599130,10cyclictest7371-21sort12:15:201
3139599130,10cyclictest18423-21aten2_r5power_p07:50:121
3139099136,6cyclictest1485-21wc07:15:000
3139099133,7cyclictest175-1kworker/0:1H+kblockd08:52:090
3139099131,9cyclictest12552-21apt08:45:120
3139099131,6cyclictest10289-21grep12:35:140
3139099130,9cyclictest831-21runrttasks07:45:080
3139099130,9cyclictest4629-21runrttasks08:27:380
3139099130,9cyclictest327-21systemd-journal07:39:370
3139099130,9cyclictest29738-21chrt08:13:520
3139099130,9cyclictest14163-21cut07:40:170
3139099130,7cyclictest175-1kworker/0:1H+kblockd09:00:180
3139099130,7cyclictest1478-21ssh09:15:080
3139099130,11cyclictest5169-21aten2_r5power_e08:30:150
3139099130,10cyclictest744-21snmpd07:26:260
3139099130,10cyclictest31402-21/usr/sbin/munin08:15:230
3139099130,10cyclictest1950-21ssh09:50:090
2373639130,8EcMasterDemoSyn24015-21taskset09:09:565
2079429130,3tAtEmLog_020964-21taskset10:17:445
1768329130,11tAtEmLog_019354-21chrt07:50:175
1172099130,11tDemoTimingTask17479-21chrt10:50:445
686039120,1EcMasterDemoSyn671rcuc/511:03:175
684729120,10tAtEmLog_06900-21chrt08:31:305
655299120,10tDemoTimingTask8201-21chrt07:27:435
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional