You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 02:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Jan 11, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
263592930,1sleep126358-21perl00:00:151
1035439930,0EcMasterDemoSyn1036429tAtEmLog_020:09:025
783739920,0EcMasterDemoSyn784729tAtEmLog_022:56:205
2698539830,0EcMasterDemoSyn2699529tAtEmLog_021:55:305
1576139830,0EcMasterDemoSyn1577129tAtEmLog_021:14:575
1576139830,0EcMasterDemoSyn1577129tAtEmLog_021:14:575
1087739830,0EcMasterDemoSyn1088729tAtEmLog_000:27:385
326239820,0EcMasterDemoSyn327229tAtEmLog_019:53:495
2721439820,0EcMasterDemoSyn2722429tAtEmLog_020:44:315
2643039820,0EcMasterDemoSyn2644029tAtEmLog_023:06:305
2582739820,0EcMasterDemoSyn2583729tAtEmLog_023:42:005
1773639820,0EcMasterDemoSyn1774629tAtEmLog_021:50:265
666939810,0EcMasterDemoSyn667929tAtEmLog_021:09:535
2557039810,0EcMasterDemoSyn2558029tAtEmLog_019:33:315
2483739810,0EcMasterDemoSyn2484729tAtEmLog_020:39:275
193139810,0EcMasterDemoSyn194129tAtEmLog_020:59:435
1736939810,0EcMasterDemoSyn1737929tAtEmLog_022:25:565
2220839370,1EcMasterDemoSyn22213-21runintdemo5min22:10:434
219552260,0sleep40-21swapper/421:53:204
799939200,0EcMasterDemoSyn0-21swapper/520:03:585
3095399190,11tDemoTimingTask6510-21chrt21:45:025
2247939190,10EcMasterDemoSyn22557-21taskset20:34:555
2682199180,8tDemoTimingTask29526-21chrt22:32:525
2108129180,0tAtEmLog_00-21swapper/500:02:165
1612899180,8tDemoTimingTask18284-21chrt19:15:565
1398799181,13cyclictest16-1pr/legacy22:30:592
1398799181,12cyclictest16-1pr/legacy22:51:162
1397799186,7cyclictest20101-21ssh21:52:010
1397799185,9cyclictest831-21runrttasks21:25:030
1397799180,10cyclictest831-21runrttasks00:09:540
1397799180,10cyclictest25379-21sh22:12:560
1397799180,10cyclictest18367-21sh22:26:360
1397799180,10cyclictest14386-21sh21:49:240
287399170,10tDemoTimingTask2901-21taskset23:47:055
1399499170,9cyclictest4754-21mailstats23:30:214
13981991714,2cyclictest731-21gdbus21:40:011
1397799170,9cyclictest7737-21fschecks_count21:10:140
1397799170,9cyclictest7737-21fschecks_count21:10:140
1397799170,9cyclictest3308-21sh00:23:350
1397799170,9cyclictest29411-21sh00:38:030
1397799170,9cyclictest1673-21diskmemload23:46:130
1397799170,9cyclictest13421-21sh00:10:350
1397799170,10cyclictest831-21runrttasks20:42:300
1612899160,7tDemoTimingTask16233-21chrt19:14:205
1399499166,7cyclictest27522-21apache222:26:584
1399099169,5cyclictest29034-21grep19:40:153
1399099164,9cyclictest1228-21expr22:35:193
1399099164,8cyclictest11121-21cstates20:10:143
1399099161,6cyclictest2612650latency_hist23:25:013
1399099161,11cyclictest16-1pr/legacy23:52:073
1399099161,11cyclictest16-1pr/legacy23:47:033
1398799164,8cyclictest23961-21open_inodes20:35:182
1398799160,9cyclictest9844-21sh22:04:462
1398799160,12cyclictest16-1pr/legacy21:04:472
1398199168,6cyclictest17092-21cron23:20:001
13981991612,3cyclictest14124-21turbostat22:25:001
1397799165,6cyclictest21256-21fschecks_time21:35:150
1397799164,8cyclictest20028-21sh00:32:460
1397799160,9cyclictest8839-21kworker/u24:1+flush-9:023:51:100
1197739160,9EcMasterDemoSyn16336-21taskset23:55:005
3060729150,0tAtEmLog_00-21swapper/523:31:505
2799099150,9tDemoTimingTask25735-21sleep19:39:555
182529150,6tAtEmLog_02306-21taskset00:22:535
1399499154,8cyclictest22469-21latency_hist23:05:004
1399499154,8cyclictest22469-21latency_hist23:05:004
1399499153,9cyclictest744-21snmpd22:35:164
1399099151,10cyclictest10262-21sh21:46:293
1399099150,9cyclictest17446-21if_err_enp5s023:55:163
1398799154,6cyclictest7142-21latency_hist23:50:002
1398799153,9cyclictest807-21postgres19:11:002
1398799153,8cyclictest7385-21unixbench_multi22:20:222
13987991511,3cyclictest717-21in:imuxsock21:25:002
1398799151,10cyclictest8309-21latency_hist20:04:592
1398799151,10cyclictest25616-21grep21:55:142
1398799151,10cyclictest14951-21ssh21:49:472
1398799150,9cyclictest25949-21sh00:18:022
1398799150,9cyclictest14489-21sh22:42:202
1398799150,8cyclictest15059-21runrttasks20:18:592
1398199156,7cyclictest3967-21wc00:05:261
13981991511,3cyclictest864-21runintdemo5min22:10:431
1398199150,10cyclictest18052-21ssh23:38:031
1397799152,9cyclictest21297-21sh23:21:370
1397799151,12cyclictest4121-21cat22:55:000
1397799151,10cyclictest30147-21sh23:09:040
1397799150,8cyclictest831-21runrttasks20:49:160
1397799150,8cyclictest28326-21sh21:56:230
1397799150,7cyclictest175-1kworker/0:1H+kblockd20:53:210
1397799150,12cyclictest808-21postgres23:19:100
1397799150,11cyclictest12770-21runintdemo5min22:41:090
1397799150,10cyclictest175-1kworker/0:1H+kblockd19:38:340
666939140,0EcMasterDemoSyn6676-21grep21:09:533
1399499141,9cyclictest8484-21sh22:21:024
1399499141,9cyclictest6196-21/usr/sbin/munin20:00:144
1399499141,9cyclictest25250-21/usr/sbin/munin20:40:124
1399499141,9cyclictest20465-21sh21:16:524
1399499141,9cyclictest13006-21sh22:59:594
13994991411,2cyclictest16049-21runintdemo5min00:12:264
1399499140,12cyclictest28256-21sed19:40:014
1399499140,11cyclictest14534-21ssh23:53:564
1399499140,10cyclictest831-21runrttasks22:50:354
1399499140,10cyclictest831-21runrttasks20:36:354
1399499140,10cyclictest831-21runrttasks20:05:024
1399499140,10cyclictest6439-21ssh23:13:514
1399499140,10cyclictest5931-21wget00:25:134
1399499140,10cyclictest4352-21ssh22:00:544
1399499140,10cyclictest31512-21ssh00:03:084
1399499140,10cyclictest31277-21/usr/sbin/munin20:50:224
1399499140,10cyclictest24890-21/usr/sbin/munin21:55:244
1399499140,10cyclictest23722-21ssh00:35:124
1399499140,10cyclictest20481-21ssh21:35:084
1399499140,10cyclictest18486-21ssh00:31:414
1399499140,10cyclictest17934-21cat20:25:004
1399499140,10cyclictest14981-21ssh23:35:544
1399499140,10cyclictest10726-21ssh21:11:274
1399499140,10cyclictest10726-21ssh21:11:274
1399099141,9cyclictest5871-21sh21:26:303
1399099141,9cyclictest28796-21sh22:50:163
1399099141,9cyclictest26023-21taskset19:35:083
1399099141,9cyclictest20695-21irqstats22:10:183
1399099141,9cyclictest12170-21diskmemload23:35:043
1399099141,9cyclictest12060-21diskmemload22:40:393
1399099141,8cyclictest16-1pr/legacy00:17:283
1399099141,10cyclictest9336-21ssh22:57:233
1399099141,10cyclictest4010-21runrttasks21:00:513
1399099141,10cyclictest18442-21runrttasks21:15:273
1399099140,9cyclictest831-21runrttasks20:35:113
1399099140,9cyclictest30183-21ssh23:26:293
1399099140,11cyclictest17919-21sed19:15:223
1399099140,10cyclictest8484-21grep21:10:183
1399099140,10cyclictest8484-21grep21:10:183
1399099140,10cyclictest6690-21rm00:07:103
1399099140,10cyclictest6239-21ssh23:31:063
1399099140,10cyclictest582-21ssh00:04:133
1399099140,10cyclictest5504-21rm21:44:453
1399099140,10cyclictest5065-21sh22:01:243
1399099140,10cyclictest32355-21/usr/sbin/munin20:55:113
1399099140,10cyclictest32003-21/usr/sbin/munin23:10:183
1399099140,10cyclictest28742-21ssh22:15:033
1399099140,10cyclictest26968-21ssh21:55:303
1399099140,10cyclictest26818-21/usr/sbin/munin21:20:183
1399099140,10cyclictest24099-21ssh21:36:293
1399099140,10cyclictest24000-21/usr/sbin/munin22:30:173
1399099140,10cyclictest23606-21sh21:54:293
1399099140,10cyclictest21383-21wget19:25:113
1399099140,10cyclictest21383-21wget19:25:113
1399099140,10cyclictest17951-21sh23:01:513
1399099140,10cyclictest17951-21sh23:01:513
1399099140,10cyclictest17385-21ssh00:30:523
1399099140,10cyclictest15881-21chrt22:25:193
1399099140,10cyclictest15595-21aten2_r5power_p20:20:133
1399099140,10cyclictest14392-21ssh21:31:043
1399099140,10cyclictest14241-21/usr/sbin/munin19:10:203
1399099140,10cyclictest14119-21ssh00:11:043
1399099140,10cyclictest13656-21ssh22:06:043
1399099140,10cyclictest13391-21grep20:15:143
1399099140,10cyclictest11103-21ssh23:15:483
1398799142,7cyclictest5017-21kworker/u24:2+nfsiod23:59:412
1398799141,9cyclictest9823-21ssh23:50:362
1398799141,9cyclictest9702-21taskset00:09:182
1398799141,9cyclictest744-21snmpd20:10:042
1398799141,9cyclictest23117-21sh22:47:022
1398799141,9cyclictest17990-21ssh22:26:202
13987991411,2cyclictest29005-21runintdemo5min00:37:462
1398799141,10cyclictest32553-21runrttasks20:55:122
1398799141,10cyclictest16-1pr/legacy21:14:562
1398799141,10cyclictest16-1pr/legacy21:14:552
1398799141,10cyclictest16-1pr/legacy20:54:392
1398799140,9cyclictest27309-21cat00:00:242
1398799140,10cyclictest8472-21ssh00:25:542
1398799140,10cyclictest831-21runrttasks23:26:332
1398799140,10cyclictest5298-21hddtemp_smartct22:55:142
1398799140,10cyclictest4677-21/usr/sbin/munin21:05:182
1398799140,10cyclictest3335-21/usr/sbin/munin23:30:202
1398799140,10cyclictest30304-21processes22:15:212
1398799140,10cyclictest29671-21sh21:40:082
1398799140,10cyclictest28455-21/usr/sbin/munin19:40:122
1398799140,10cyclictest2816-21diskstats21:25:142
1398799140,10cyclictest24545-21switchtime23:05:252
1398799140,10cyclictest23016-21ssh21:18:382
1398799140,10cyclictest22943-21sh21:35:412
1398799140,10cyclictest21186-21hddtemp_smartct20:30:152
1398799140,10cyclictest19807-21/usr/sbin/munin22:10:242
1398799140,10cyclictest18810-21head20:25:162
1398799140,10cyclictest17704-21sh21:33:232
1398799140,10cyclictest17501-21sh23:20:042
1398799140,10cyclictest17393-21ssh21:50:242
1398799140,10cyclictest17255-21runrttasks20:21:362
1398799140,10cyclictest1440-21sh00:22:172
1398799140,10cyclictest13883-21/usr/sbin/munin23:00:172
1398799140,10cyclictest13883-21/usr/sbin/munin23:00:172
1398799140,10cyclictest13619-21ssh23:17:322
1398199146,6cyclictest6171-21sed21:45:011
1398199143,8cyclictest855-21open_files23:10:191
1398199141,9cyclictest901-21sh00:21:551
1398199141,9cyclictest24000-21/usr/sbin/munin22:30:111
1398199141,9cyclictest22001-21ssh23:22:041
1398199141,9cyclictest16414-21/usr/sbin/munin21:15:121
1398199141,10cyclictest25332-21ssh23:05:441
1398199141,10cyclictest17974-21runrttasks21:33:351
1398199140,10cyclictest9463-21unixbench_multi23:50:241
1398199140,10cyclictest831-21runrttasks00:32:441
1398199140,10cyclictest830-21/usr/sbin/munin22:35:301
1398199140,10cyclictest744-21snmpd19:10:471
1398199140,10cyclictest6807-21rm22:55:381
1398199140,10cyclictest595-21ssh22:52:381
1398199140,10cyclictest5509-21ssh23:48:541
1398199140,10cyclictest3295-21ssh23:30:101
1398199140,10cyclictest29605-21grep22:15:161
1398199140,10cyclictest2777-21cstates21:25:141
1398199140,10cyclictest27714-21wget20:45:121
1398199140,10cyclictest26932-21taskset20:40:501
1398199140,10cyclictest26465-21ssh23:25:021
1398199140,10cyclictest26025-21/usr/sbin/munin19:35:111
1398199140,10cyclictest25343-21chrt19:30:371
1398199140,10cyclictest23721-21/usr/sbin/munin00:35:171
1398199140,10cyclictest2103-21irqstats19:50:151
1398199140,10cyclictest20874-21ssh23:57:041
1398199140,10cyclictest20521-21/usr/sbin/munin20:30:121
1398199140,10cyclictest19389-21ssh21:51:311
1398199140,10cyclictest18619-21ssh22:45:021
1398199140,10cyclictest1753-21/usr/sbin/munin22:00:131
1398199140,10cyclictest16592-21/usr/sbin/munin19:15:161
1398199140,10cyclictest15841-21tr20:20:141
1398199140,10cyclictest14801-21/usr/sbin/munin22:25:121
1398199140,10cyclictest12285-21wc22:05:231
1398199140,10cyclictest11432-21ssh21:47:181
1398199140,10cyclictest11318-21ssh00:27:561
1398199140,10cyclictest11231-21/usr/sbin/munin00:10:121
1397799146,6cyclictest22374-21ntpq19:25:190
1397799146,6cyclictest22374-21ntpq19:25:190
1397799143,8cyclictest2656-21load22:00:180
1397799143,8cyclictest14359-21tr19:10:110
1397799142,8cyclictest831-21runrttasks20:57:590
1397799141,10cyclictest24629-21missed_timers19:30:180
1397799140,8cyclictest5696-21runrttasks19:59:240
1397799140,7cyclictest6917-21/usr/sbin/munin22:20:170
1397799140,7cyclictest29604-21sh21:40:050
1397799140,7cyclictest28899-21runrttasks22:32:250
1397799140,7cyclictest22097-21diskstats23:40:140
1397799140,6cyclictest4797-21ssh23:30:210
1397799140,12cyclictest26499-21rm21:20:170
1397799140,12cyclictest175-1kworker/0:1H+kblockd22:07:080
1397799140,12cyclictest175-1kworker/0:1H+kblockd20:37:180
1397799140,11cyclictest175-1kworker/0:1H+kblockd21:07:290
1397799140,10cyclictest831-21runrttasks19:52:520
1397799140,10cyclictest744-21snmpd19:19:150
1397799140,10cyclictest7329-21python300:25:220
1397799140,10cyclictest547-21ssh22:35:070
1397799140,10cyclictest4628-21rm22:55:110
1397799140,10cyclictest31678-21perl19:45:140
1397799140,10cyclictest29010-21basename22:15:130
1397799140,10cyclictest26652-21sh23:25:100
1397799140,10cyclictest2566-21cpuspeed_turbos21:00:130
1397799140,10cyclictest25625-21sh00:00:080
1397799140,10cyclictest21597-21basename00:15:190
1397799140,10cyclictest20429-21sh23:03:370
1397799140,10cyclictest20429-21sh23:03:360
1397799140,10cyclictest19804-21cat22:45:170
1397799140,10cyclictest19522-21perl19:20:130
1397799140,10cyclictest1822-21ssh23:10:360
1397799140,10cyclictest17600-21/usr/sbin/munin21:15:170
1397799140,10cyclictest17512-21ssh23:55:160
1397799140,10cyclictest16295-21ssh23:36:500
1397799140,10cyclictest16194-21idleruntime20:20:170
1397799140,10cyclictest13008-21ssh21:30:230
2508139130,0EcMasterDemoSyn671rcuc/500:17:295
1399499134,8cyclictest23065-21/usr/sbin/munin23:05:134
1399499132,8cyclictest10436-21fschecks_time22:40:164
1399499131,9cyclictest30928-21sh23:45:084
1399499131,9cyclictest22688-21timerandwakeup19:25:234
1399499131,9cyclictest22688-21timerandwakeup19:25:234
1399499130,9cyclictest831-21runrttasks19:10:064
1399499130,9cyclictest789-21postgres19:31:004
1399499130,9cyclictest744-21snmpd20:18:074
1399499130,9cyclictest5996-21ssh00:06:404
1399499130,9cyclictest486-21mdadm22:45:024
1399499130,9cyclictest327-21systemd-journal21:05:014
1399499130,9cyclictest32355-21/usr/sbin/munin20:55:244
1399499130,9cyclictest32319-21sendmail_mailtr19:45:214
1399499130,9cyclictest29508-21sh21:40:014
1399499130,9cyclictest28694-21ssh22:15:014
1399499130,9cyclictest28672-21cpuspeed_turbos19:40:134
1399499130,9cyclictest28545-21unixbench_multi23:25:244
1399499130,9cyclictest24254-21cpuspeed_turbos22:30:124
1399499130,9cyclictest2407-21sh21:25:114
1399499130,9cyclictest2324-21/usr/sbin/munin21:00:144
1399499130,9cyclictest21499-21sh23:40:044
1399499130,9cyclictest20521-21/usr/sbin/munin20:30:124
1399499130,9cyclictest19964-21runrttasks20:27:214
1399499130,9cyclictest19317-21df19:20:124
1399499130,9cyclictest17662-21/usr/sbin/munin23:20:194
1399499130,9cyclictest16592-21/usr/sbin/munin19:15:154
1399499130,9cyclictest1347-21/usr/sbin/munin19:50:174
1399499130,9cyclictest12521-21load21:30:184
1399499130,9cyclictest10503-21ssh22:05:004
1399499130,9cyclictest10268-21sh21:46:294
1399499130,10cyclictest8632-21/usr/sbin/munin23:15:204
1399499130,10cyclictest29230-21chrt21:21:324
1399499130,10cyclictest29183-21sh00:20:074
1399499130,10cyclictest27653-21/usr/sbin/munin20:45:214
1399499130,10cyclictest25265-21sh00:17:334
1399499130,10cyclictest17282-21tail23:55:144
1399099139,3cyclictest6127-21cut22:20:123
1399099131,9cyclictest25492-21runrttasks19:32:373
1399099130,9cyclictest9960-21sed20:05:243
1399099130,9cyclictest7468-21switchtime00:25:253
1399099130,9cyclictest3694-21runrttasks19:55:063
1399099130,9cyclictest31636-21/usr/sbin/munin19:45:153
1399099130,9cyclictest30005-21/usr/sbin/munin20:50:233
1399099130,9cyclictest25780-21fschecks_time20:40:143
1399099130,9cyclictest23721-21/usr/sbin/munin00:35:153
1399099130,9cyclictest22905-21ssh23:05:103
1399099130,9cyclictest21198-21idleruntime20:30:163
1399099130,9cyclictest19364-21fschecks_count19:20:123
1399099130,9cyclictest18751-21sh22:45:073
1399099130,9cyclictest18157-21taskset20:25:033
1399099130,9cyclictest1368-21aten2_r5power_c19:50:113
1399099130,10cyclictest6950-21memory20:00:183
1399099130,10cyclictest31202-21ssh00:20:253
1399099130,10cyclictest27664-21/usr/sbin/munin20:45:113
1399099130,10cyclictest21556-21sh23:40:063
1399099130,10cyclictest13995-21latency_hist19:10:013
1398799134,7cyclictest31181-21cut19:45:122
1398799131,9cyclictest26123-21/usr/sbin/munin20:40:172
1398799130,9cyclictest5973-21latency_hist19:59:592
1398799130,9cyclictest27653-21/usr/sbin/munin20:45:152
1398799130,9cyclictest26025-21/usr/sbin/munin19:35:132
1398799130,9cyclictest25344-21chrt19:30:382
1398799130,9cyclictest21454-21runrttasks23:40:022
1398799130,9cyclictest21335-21aten2_r5power_c19:25:122
1398799130,9cyclictest21335-21aten2_r5power_c19:25:112
1398799130,9cyclictest18968-21/usr/sbin/munin19:20:102
1398799130,9cyclictest1669-21ssh22:35:212
1398799130,9cyclictest14605-21sh00:30:042
1398799130,9cyclictest14119-21latency_hist19:10:012
1398799130,9cyclictest11158-21runrttasks00:10:072
1398799130,9cyclictest1061-21apt-key19:50:012
1398799130,10cyclictest9994-21sed20:05:252
1398799130,10cyclictest31899-21ssh23:10:062
1398799130,10cyclictest12285-21/usr/sbin/munin23:35:192
1398799130,10cyclictest11728-21sh22:05:172
1398199130,9cyclictest9794-21/usr/sbin/munin22:40:191
1398199130,9cyclictest8732-21tr20:05:131
1398199130,9cyclictest831-21runrttasks20:00:561
1398199130,9cyclictest771-21sshd20:59:561
1398199130,9cyclictest744-21snmpd19:41:301
1398199130,9cyclictest7289-21atemtest21:10:111
1398199130,9cyclictest7289-21atemtest21:10:101
1398199130,9cyclictest4739-21grep21:05:121
1398199130,9cyclictest31106-21/usr/sbin/munin19:45:131
1398199130,9cyclictest30005-21/usr/sbin/munin20:50:151
1398199130,9cyclictest287-21jbd2/md0-819:55:011
1398199130,9cyclictest27953-21sh21:56:071
1398199130,9cyclictest18968-21/usr/sbin/munin19:20:091
1398199130,9cyclictest18167-21/usr/sbin/munin20:25:181
1398199130,9cyclictest13883-21/usr/sbin/munin23:00:191
1398199130,9cyclictest13883-21/usr/sbin/munin23:00:191
1398199130,9cyclictest13114-21runrttasks20:15:011
1398199130,9cyclictest11455-21idleruntime20:10:181
1398199130,10cyclictest25443-21ssh21:20:041
1398199130,10cyclictest22898-21ssh23:40:201
1398199130,10cyclictest21847-21tune2fs19:25:151
1398199130,10cyclictest21847-21tune2fs19:25:151
1398199130,10cyclictest20749-21tune2fs00:15:141
1397799134,8cyclictest29494-21/usr/sbin/munin19:40:180
1397799130,9cyclictest8588-21cpu20:05:130
1397799130,9cyclictest21118-21gltestperf20:30:140
1397799130,9cyclictest13220-21/usr/sbin/munin20:15:130
1397799130,9cyclictest11278-21perl20:10:170
1397799130,7cyclictest175-1kworker/0:1H+kblockd20:25:280
1397799130,10cyclictest175-1kworker/0:1H+kblockd20:00:080
1139599130,10tDemoTimingTask13560-21chrt19:05:545
820299120,9tDemoTimingTask10612-21chrt22:22:325
319339120,0EcMasterDemoSyn0-21swapper/523:11:345
3060729120,2tAtEmLog_031959-21chrt23:27:435
2682199120,2tDemoTimingTask482-21chrt22:35:045
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional