You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-21 - 02:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Sep 21, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2612339830,0EcMasterDemoSyn2613329tAtEmLog_023:36:015
123839830,0EcMasterDemoSyn124829tAtEmLog_020:18:155
1070439830,0EcMasterDemoSyn1071429tAtEmLog_020:38:325
535439820,0EcMasterDemoSyn536429tAtEmLog_022:30:075
522439820,0EcMasterDemoSyn523429tAtEmLog_019:17:245
372739820,0EcMasterDemoSyn373729tAtEmLog_021:34:195
366739820,0EcMasterDemoSyn367729tAtEmLog_000:36:525
366739820,0EcMasterDemoSyn367729tAtEmLog_000:36:525
33339820,0EcMasterDemoSyn34629tAtEmLog_021:14:025
1784839820,0EcMasterDemoSyn1785829tAtEmLog_020:53:455
1143639820,0EcMasterDemoSyn1144629tAtEmLog_023:46:105
517439810,0EcMasterDemoSyn518429tAtEmLog_023:05:355
43039810,0EcMasterDemoSyn44029tAtEmLog_019:07:155
1458039810,0EcMasterDemoSyn1459029tAtEmLog_022:35:105
1458039810,0EcMasterDemoSyn1459029tAtEmLog_022:35:105
3055639800,0EcMasterDemoSyn3056629tAtEmLog_021:49:325
258439800,0EcMasterDemoSyn259429tAtEmLog_023:41:055
123839780,0EcMasterDemoSyn1247-21runintdemo5min20:18:152
2885439560,0EcMasterDemoSyn28863-21runintdemo5min22:25:013
304142470,0sleep50-21swapper/523:20:175
77699241,14cyclictest28817-21cat22:25:000
77699240,10cyclictest30084-21sh22:07:010
77699230,14cyclictest5150-21sh00:00:330
77699230,10cyclictest27673-21sh21:29:330
77699220,9cyclictest11402-21sh21:38:290
77699220,10cyclictest12439-21runrttasks19:33:360
776992112,2cyclictest24391-21systemctl20:00:000
782992011,7cyclictest31251-21cron00:35:011
1602529190,0tAtEmLog_00-21swapper/522:04:435
146299190,10tDemoTimingTask1670-21chrt22:09:565
78699180,10cyclictest17604-21ssh00:26:232
77699180,14cyclictest785-21runrttasks20:57:140
77699180,14cyclictest6656-21sh00:39:030
77699180,14cyclictest6656-21sh00:39:030
77699180,14cyclictest32019-21sh00:16:030
77699180,14cyclictest10441-21sh23:45:260
77699180,10cyclictest4572-21sh21:15:390
1936399180,10tDemoTimingTask19381-21chrt22:19:585
1233999180,8tDemoTimingTask12420-21chrt19:33:215
794991713,3cyclictest694-21rs:main4
78299179,6cyclictest21421-21cut23:15:211
77699175,9cyclictest18225-21sh21:24:080
77699170,9cyclictest32640-21sh22:26:350
77699170,9cyclictest22190-21diskmemload22:57:130
77699170,9cyclictest13333-21sh00:24:390
77699170,9cyclictest10365-21sh21:55:320
77699170,14cyclictest31393-21sh22:44:490
77699170,14cyclictest12521-21sh22:51:500
2259599170,10tDemoTimingTask22699-21chrt21:04:565
1724929170,10tAtEmLog_017350-21taskset23:31:025
1712799170,9tDemoTimingTask17614-21taskset19:45:005
146299170,7tDemoTimingTask9750-21taskset22:14:275
1233999170,7tDemoTimingTask12841-21chrt19:35:055
997629160,10tAtEmLog_09981-21chrt19:27:335
78699165,8cyclictest2358-21hostname21:15:122
78699160,9cyclictest13090-21ssh00:24:292
78299160,9cyclictest30178-21sh23:01:381
78299160,9cyclictest17794-21sh21:41:381
77699160,7cyclictest28489-21vmstat23:55:240
77699160,7cyclictest20091-21sh23:33:000
77699160,11cyclictest11494-21sh23:28:110
2021429160,10tAtEmLog_020219-21taskset20:58:495
1012629160,9tAtEmLog_010145-21taskset22:50:235
79499153,9cyclictest23074-21cut21:45:124
79499152,9cyclictest7419-21sh00:02:124
79499151,10cyclictest17147-21ssh22:18:234
79499150,9cyclictest5784-21fschecks_count21:35:154
79499150,9cyclictest22209-21sh22:57:144
78999150,9cyclictest8244-21sh21:36:113
78999150,11cyclictest2105-21ssh21:33:083
78999150,10cyclictest6811-21ssh22:49:053
78699158,5cyclictest18806-21find19:45:202
78699151,10cyclictest25047-21ssh23:17:142
78699150,9cyclictest13487-21diskmemload21:20:422
78699150,10cyclictest5121-21ssh23:24:572
78299158,5cyclictest30006-21grep23:20:141
78299151,10cyclictest2004550latency_hist23:15:011
78299150,11cyclictest9813-21rm21:37:191
77699156,8cyclictest16482-21/usr/sbin/munin19:40:220
77699156,7cyclictest785-21runrttasks23:43:010
77699156,7cyclictest7251-21ssh23:07:050
77699156,7cyclictest18419-21ssh22:00:200
77699156,5cyclictest24044-21fschecks_time23:35:180
77699152,6cyclictest17186-21dpkg23:50:010
77699151,10cyclictest22294-21cat19:54:590
77699150,9cyclictest19772-21sh21:43:050
77699150,7cyclictest15596-21basename20:50:000
77699150,14cyclictest11992-21ls00:05:130
77699150,12cyclictest2291-21sh23:04:540
77699150,11cyclictest5486-21sh22:30:090
2886599153,6tDemoTimingTask28966-21taskset22:25:055
2722599150,9tDemoTimingTask27325-21taskset21:29:185
230052150,1sleep123007-21rm21:45:111
79499146,6cyclictest334-21systemd-journal23:02:244
79499143,8cyclictest3555-21seq20:22:324
79499143,6cyclictest6549-21aten2_r5power_v20:30:154
79499142,8cyclictest11744-21/usr/sbin/munin00:05:244
79499141,9cyclictest6561-21sh21:17:064
79499141,9cyclictest3109-21latency_hist19:15:014
79499141,9cyclictest27599-21diskmemload00:14:124
79499141,9cyclictest22715-21latency_hist21:05:014
79499141,9cyclictest12327-21sh22:51:424
79499140,7cyclictest9431-21ssh22:31:514
79499140,10cyclictest8387-21sh00:21:024
79499140,10cyclictest28871-21ssh21:30:134
79499140,10cyclictest24441-21sh22:22:014
79499140,10cyclictest23091-21/usr/sbin/munin00:30:234
79499140,10cyclictest20622-21uniq21:25:144
79499140,10cyclictest20104-21ssh22:01:104
79499140,10cyclictest1759-21latency_hist22:10:004
79499140,10cyclictest14508-21sh21:21:264
79499140,10cyclictest13768-21tr20:45:134
79499140,10cyclictest10673-21seq20:38:164
78999145,8cyclictest19564-21/usr/sbin/munin20:55:243
78999143,9cyclictest15386-21/usr/sbin/munin21:40:193
78999141,9cyclictest7076-21diskmemload00:20:223
78999141,9cyclictest13531-21/usr/sbin/munin20:45:183
78999141,9cyclictest12233-21/usr/sbin/munin22:15:193
78999141,10cyclictest16-1pr/legacy22:40:133
78999141,10cyclictest16-1pr/legacy20:53:443
78999141,10cyclictest16-1pr/legacy20:18:143
78999141,10cyclictest16-1pr/legacy20:03:013
789991410,3cyclictest27211-21fschecks_time23:00:173
78999140,9cyclictest22333-21/usr/sbin/munin19:55:153
78999140,9cyclictest10631-21sh21:55:443
78999140,10cyclictest9611-21timerwakeupswit19:25:243
78999140,10cyclictest8635-21/usr/sbin/munin22:50:153
78999140,10cyclictest785-21runrttasks23:12:213
78999140,10cyclictest785-21runrttasks22:10:213
78999140,10cyclictest7551-21ssh22:30:293
78999140,10cyclictest715-21snmpd23:15:093
78999140,10cyclictest7060-21chrt19:20:243
78999140,10cyclictest5489-21diskmemload23:05:483
78999140,10cyclictest5466-21latency_hist19:20:003
78999140,10cyclictest4886-21latency20:25:183
78999140,10cyclictest4390-21ssh21:15:303
78999140,10cyclictest3637-21fschecks_time00:00:153
78999140,10cyclictest31582-21ssh21:50:013
78999140,10cyclictest31199-21chrt20:12:163
78999140,10cyclictest29108-21latency_hist20:10:003
78999140,10cyclictest28597-21ssh23:55:303
78999140,10cyclictest27961-21sh22:05:273
78999140,10cyclictest26847-21latency21:10:183
78999140,10cyclictest26774-21ssh21:46:453
78999140,10cyclictest25164-21ls23:35:273
78999140,10cyclictest25057-21rm21:27:413
78999140,10cyclictest24290-21ssh22:21:553
78999140,10cyclictest23112-21ssh00:30:113
78999140,10cyclictest23046-21ssh22:57:503
78999140,10cyclictest22680-21chrt00:10:353
78999140,10cyclictest22668-21taskset21:04:303
78999140,10cyclictest22289-21ssh22:02:463
78999140,10cyclictest20426-21sh23:51:073
78999140,10cyclictest19648-21chrt19:49:413
78999140,10cyclictest17632-21sh22:36:093
78999140,10cyclictest17632-21sh22:36:093
78999140,10cyclictest1687-21rm23:40:273
78999140,10cyclictest15420-21ssh00:06:383
78999140,10cyclictest15225-21/usr/sbin/munin19:40:113
78999140,10cyclictest14909-21sh00:25:133
78999140,10cyclictest14905-21latency_hist19:40:003
78999140,10cyclictest14429-21ssh23:30:073
78999140,10cyclictest13112-21ssh23:47:233
78999140,10cyclictest11974-21latency20:40:173
78999140,10cyclictest11974-21latency20:40:173
78999140,10cyclictest1179-21ssh00:17:103
78999140,10cyclictest10502-21/usr/sbin/munin19:30:203
78699144,8cyclictest6253-21/usr/sbin/munin19:20:162
78699143,8cyclictest13724-21awk23:10:272
78699142,9cyclictest4012-21sh00:19:132
78699141,9cyclictest785-21runrttasks23:01:452
78699141,9cyclictest5004-21sh23:05:282
78699141,9cyclictest21961-21postgres19:54:112
78699141,9cyclictest20999-21runrttasks22:01:502
78699141,10cyclictest16-1pr/legacy22:14:522
78699140,8cyclictest6069-21cpuspeed_turbos23:25:132
78699140,11cyclictest31030-21ssh22:07:432
78699140,11cyclictest231-1md0_raid100:06:582
78699140,11cyclictest22846-21rm00:10:432
78699140,10cyclictest9870-21rm00:04:002
78699140,10cyclictest8690-21ssh21:36:302
78699140,10cyclictest785-21runrttasks23:52:422
78699140,10cyclictest785-21runrttasks22:35:222
78699140,10cyclictest785-21runrttasks22:35:222
78699140,10cyclictest785-21runrttasks21:50:462
78699140,10cyclictest6811-21df_inode20:30:162
78699140,10cyclictest491-21sh21:32:002
78699140,10cyclictest3400-21runrttasks20:20:272
78699140,10cyclictest31970-21sh00:35:052
78699140,10cyclictest31970-21sh00:35:052
78699140,10cyclictest31728-21sh22:25:552
78699140,10cyclictest2970-21ssh22:46:162
78699140,10cyclictest2703-21runrttasks23:41:102
78699140,10cyclictest26559-21/usr/sbin/munin23:55:162
78699140,10cyclictest23723-21perl00:30:142
78699140,10cyclictest22714-21sh21:25:582
78699140,10cyclictest22530-21taskset22:57:282
78699140,10cyclictest20384-21sh23:33:142
78699140,10cyclictest20337-21/usr/sbin/munin22:20:142
78699140,10cyclictest18309-21aten2_r5power_c20:55:132
78699140,10cyclictest16225-21sh23:49:412
78699140,10cyclictest14710-21fschecks_time21:40:142
78699140,10cyclictest12602-21sh21:57:112
78299146,6cyclictest31539-21wc20:15:001
78299146,6cyclictest20678-21tail21:25:151
78299141,9cyclictest5729-21/usr/sbin/munin23:25:191
78299141,9cyclictest3408-21/usr/sbin/munin19:15:211
78299141,9cyclictest23535-21ssh00:11:141
78299141,9cyclictest15848-21runrttasks22:17:271
78299141,10cyclictest20474-21sh23:33:181
78299141,10cyclictest15108-21runrttasks22:35:151
78299141,10cyclictest15108-21runrttasks22:35:151
78299141,10cyclictest14346-21sh22:53:101
78299140,9cyclictest1740-21/usr/sbin/munin20:20:251
78299140,8cyclictest5523-21sh00:20:071
78299140,12cyclictest5036-21ssh21:53:061
78299140,10cyclictest9714-21rm22:32:031
78299140,10cyclictest8271-21latency_hist22:50:001
78299140,10cyclictest8247-21ssh21:55:111
78299140,10cyclictest8048-21ssh22:13:121
78299140,10cyclictest785-21runrttasks23:54:191
78299140,10cyclictest7548-21ssh21:17:491
78299140,10cyclictest715-21snmpd21:34:231
78299140,10cyclictest6676-21ssh23:06:401
78299140,10cyclictest32113-21/usr/sbin/munin00:35:151
78299140,10cyclictest32113-21/usr/sbin/munin00:35:151
78299140,10cyclictest3077-21ssh22:28:391
78299140,10cyclictest29860-21sh23:38:451
78299140,10cyclictest28840-21ssh21:11:091
78299140,10cyclictest28748-21runrttasks23:55:361
78299140,10cyclictest28084-21ssh22:42:221
78299140,10cyclictest26008-21sendmail23:00:001
78299140,10cyclictest25949-21/usr/sbin/munin22:05:171
78299140,10cyclictest20337-21/usr/sbin/munin22:20:241
78299140,10cyclictest19345-21ssh22:00:361
78299140,10cyclictest18669-21fschecks_count20:55:151
78299140,10cyclictest16156-21tr20:50:131
78299140,10cyclictest15524-21ssh21:22:111
78299140,10cyclictest15113-21rm23:48:521
78299140,10cyclictest14165-21ssh00:25:031
78299140,10cyclictest10624-21chrt20:37:361
77699146,6cyclictest27416-21/usr/sbin/munin20:05:150
77699145,7cyclictest30238-21ssh23:20:160
77699141,11cyclictest24224-21cat21:05:190
77699141,10cyclictest16-1pr/legacy00:26:420
77699140,9cyclictest3768-21sh22:10:220
77699140,7cyclictest689-21/usr/sbin/munin21:50:220
77699140,7cyclictest23735-21tr00:30:150
77699140,10cyclictest785-21runrttasks22:47:300
77699140,10cyclictest785-21runrttasks21:13:490
77699140,10cyclictest5605-21cat20:25:250
77699140,10cyclictest32021-21cpuspeed_turbos20:15:120
77699140,10cyclictest30104-21sh21:49:120
77699140,10cyclictest28663-21sh21:30:040
77699140,10cyclictest26528-21taskset20:02:410
77699140,10cyclictest20893-21cpuspeed_turbos21:00:100
77699140,10cyclictest19388-21ssh22:37:250
77699140,10cyclictest19388-21ssh22:37:250
77699140,10cyclictest13293-21sh22:15:360
79499135,6cyclictest31818-21aten2_r5power_e20:15:124
79499133,5cyclictest9354-21cat21:55:194
79499132,8cyclictest25784-21open_files20:00:194
79499131,9cyclictest13313-21sh23:47:324
79499130,9cyclictest808-21runintdemo5min22:45:174
79499130,9cyclictest785-21runrttasks21:05:434
79499130,9cyclictest785-21runrttasks19:49:184
79499130,9cyclictest725-21sshd19:18:234
79499130,9cyclictest5762-21runrttasks20:25:354
79499130,9cyclictest5689-21ssh23:25:094
79499130,9cyclictest3763-21ssh22:10:214
79499130,9cyclictest32113-21/usr/sbin/munin00:35:214
79499130,9cyclictest32113-21/usr/sbin/munin00:35:204
79499130,9cyclictest29962-21perl20:10:154
79499130,9cyclictest2996-21/usr/sbin/munin23:05:264
79499130,9cyclictest29342-21/usr/sbin/munin23:20:124
79499130,9cyclictest28999-21chrt00:15:014
79499130,9cyclictest27818-21proc_pri23:55:194
79499130,9cyclictest27059-21/usr/sbin/munin20:05:134
79499130,9cyclictest25729-21sh21:10:044
79499130,9cyclictest23392-21/usr/sbin/munin22:40:194
79499130,9cyclictest23096-21chrt23:35:004
79499130,9cyclictest20341-21ssh23:15:024
79499130,9cyclictest18288-21/usr/sbin/munin20:55:264
79499130,9cyclictest17256-21cat23:50:004
79499130,9cyclictest16360-21timerandwakeup22:35:254
79499130,9cyclictest16360-21timerandwakeup22:35:254
79499130,9cyclictest15225-21/usr/sbin/munin19:40:124
79499130,9cyclictest14302-21ssh23:30:024
79499130,9cyclictest14200-21diskmemload00:25:044
79499130,9cyclictest14012-21sh21:40:074
79499130,9cyclictest12852-21/usr/sbin/munin19:35:134
79499130,9cyclictest11780-21/usr/sbin/munin23:10:134
79499130,9cyclictest11171-21chrt20:40:034
79499130,9cyclictest11171-21chrt20:40:034
79499130,10cyclictest9667-21grep19:25:244
79499130,10cyclictest907-21cat19:10:014
79499130,10cyclictest5998-21sort19:20:144
79499130,10cyclictest5181-21sh23:42:594
79499130,10cyclictest31707-21sh21:50:074
79499130,10cyclictest24127-21chrt19:57:194
79499130,10cyclictest12194-21runrttasks19:30:584
78999135,6cyclictest645-21dbus-daemon00:35:013
78999135,6cyclictest645-21dbus-daemon00:35:003
78999131,10cyclictest16-1pr/legacy20:33:273
78999130,9cyclictest8802-21/usr/sbin/munin20:35:163
78999130,9cyclictest785-21runrttasks19:50:533
78999130,9cyclictest5490-21runrttasks23:25:013
78999130,9cyclictest29898-21fschecks_time23:20:143
78999130,9cyclictest1421-21/usr/sbin/munin19:10:173
78999130,10cyclictest24187-21taskset21:05:183
78999130,10cyclictest2043-21grep20:20:133
78999130,10cyclictest10944-21ssh21:20:023
78699131,9cyclictest25324-21sh21:45:422
78699131,9cyclictest11241-21if_err_enp6s019:30:192
78699131,7cyclictest719-21latency_hist19:10:012
78699130,9cyclictest785-21runrttasks20:51:302
78699130,9cyclictest785-21runrttasks20:43:502
78699130,9cyclictest785-21runrttasks20:43:502
78699130,9cyclictest755-21postgres20:46:122
78699130,9cyclictest5203-21runrttasks19:17:152
78699130,9cyclictest27059-21/usr/sbin/munin20:05:182
78699130,9cyclictest27005-21sed21:10:192
78699130,9cyclictest25771-21sh23:35:462
78699130,9cyclictest25613-21sh22:40:342
78699130,9cyclictest24046-21runrttasks19:56:142
78699130,9cyclictest14571-21taskset19:36:202
78699130,9cyclictest12950-21sh22:52:092
78699130,10cyclictest8549-21cut19:25:142
78699130,10cyclictest5425-21rm22:30:072
78699130,10cyclictest4437-21cstates20:25:152
78699130,10cyclictest31325-21runrttasks20:13:192
78699130,10cyclictest23405-21wget21:05:142
78699130,10cyclictest15549-21tr19:40:122
78699130,10cyclictest14680-21ssh22:16:362
78699130,10cyclictest1126-21aten2_r5power_p19:10:152
78299135,6cyclictest4214-21tr20:25:141
78299135,3cyclictest18565-21sed19:45:181
78299131,9cyclictest290-21jbd2/md0-819:55:181
78299131,9cyclictest12587-21ssh00:05:171
78299130,9cyclictest930-21ntp_kernel_pll_23:40:191
78299130,9cyclictest8141-21/usr/sbin/munin19:25:181
78299130,9cyclictest6452-21/usr/sbin/munin20:30:171
78299130,9cyclictest5775-21runrttasks19:20:031
78299130,9cyclictest31757-21/usr/sbin/munin20:15:141
78299130,9cyclictest3099-21ssh00:00:121
78299130,9cyclictest29189-21sh00:15:101
78299130,9cyclictest26506-21chrt20:02:241
78299130,9cyclictest25186-21runrttasks21:08:211
78299130,9cyclictest20653-21taskset21:00:041
78299130,9cyclictest19982-21/usr/sbin/munin19:50:171
78299130,9cyclictest15225-21/usr/sbin/munin19:40:171
78299130,9cyclictest13531-21/usr/sbin/munin20:45:151
78299130,9cyclictest12852-21/usr/sbin/munin19:35:131
78299130,9cyclictest11182-21/usr/sbin/munin20:40:121
78299130,9cyclictest11182-21/usr/sbin/munin20:40:121
78299130,9cyclictest1056-21/usr/sbin/munin19:10:151
78299130,9cyclictest10485-21runrttasks19:30:011
78299130,10cyclictest28897-21runrttasks20:07:561
77699135,6cyclictest704-21gdbus20:20:210
77699131,9cyclictest785-21runrttasks19:35:520
77699130,9cyclictest9163-21df_inode20:35:130
77699130,9cyclictest8264-21grep19:25:130
77699130,9cyclictest785-21runrttasks20:13:270
77699130,9cyclictest6980-21fschecks_time20:30:160
77699130,9cyclictest21074-21sh23:15:190
77699130,9cyclictest20339-21ssh00:10:040
77699130,9cyclictest16834-21missed_timers20:50:180
77699130,9cyclictest11716-21sh23:10:100
77699130,9cyclictest11655-21fschecks_time20:40:150
77699130,9cyclictest11655-21fschecks_time20:40:150
77699130,7cyclictest103-1kworker/0:1H+kblockd19:49:280
77699130,6cyclictest7121-21sed19:20:240
77699130,10cyclictest1379-21expr19:10:150
79499120,9cyclictest20485-21fschecks_time19:50:154
79499120,9cyclictest16726-21/usr/sbin/munin20:50:174
78699120,9cyclictest9480-21/usr/sbin/munin20:35:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional