You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 07:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Mon Dec 22, 2025 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11214391650,0EcMasterDemoSyn0-21swapper/423:43:004
29884391310,0EcMasterDemoSyn0-21swapper/422:42:104
846821050,1sleep08469-21ls20:45:000
703439920,0EcMasterDemoSyn704429tAtEmLog_023:22:435
2891139920,0EcMasterDemoSyn2892129tAtEmLog_020:20:105
204239910,0EcMasterDemoSyn205229tAtEmLog_023:37:575
2333439830,0EcMasterDemoSyn2334429tAtEmLog_021:10:545
110339830,0EcMasterDemoSyn111329tAtEmLog_000:13:275
2538739820,0EcMasterDemoSyn2539729tAtEmLog_022:57:235
2534139820,0EcMasterDemoSyn2535129tAtEmLog_023:32:525
2469139820,0EcMasterDemoSyn2470229tAtEmLog_021:46:225
216139820,0EcMasterDemoSyn217129tAtEmLog_023:02:265
2055039820,0EcMasterDemoSyn2056029tAtEmLog_023:12:365
1976139820,0EcMasterDemoSyn1977129tAtEmLog_021:05:485
1621739820,0EcMasterDemoSyn1622629tAtEmLog_023:27:475
584739810,0EcMasterDemoSyn585729tAtEmLog_021:36:145
584739810,0EcMasterDemoSyn585729tAtEmLog_021:36:145
2957239810,0EcMasterDemoSyn2958229tAtEmLog_022:06:395
2446239810,0EcMasterDemoSyn2447229tAtEmLog_000:08:215
2416439810,0EcMasterDemoSyn2417429tAtEmLog_020:10:025
1532639290,0EcMasterDemoSyn15335-21runintdemo5min21:41:182
503939210,1EcMasterDemoSyn5046-21grep20:35:232
27117991811,3cyclictest20458-21fschecks_time23:30:152
2710699185,9cyclictest831-21runrttasks20:48:360
2710699180,15cyclictest18129-21sh22:53:520
2710699180,10cyclictest28353-21sh21:48:520
2712799179,6cyclictest20109-21cron21:10:004
27127991713,3cyclictest31456-21gltestperf00:30:154
27127991711,5cyclictest23133-21ssh21:45:254
27117991713,3cyclictest644-21dbus-daemon00:30:002
2710699175,7cyclictest8327-21sh22:30:220
2710699170,9cyclictest28118-21sh23:16:210
2710699170,9cyclictest26864-21sh23:33:560
2710699170,9cyclictest26767-21ssh00:27:320
2710699170,9cyclictest24707-21sh22:39:560
2710699170,9cyclictest18750-21sh23:46:580
2056029170,0tAtEmLog_0651irq_work/523:17:385
1031829170,7tAtEmLog_010616-21chrt20:49:115
2712799168,6cyclictest10426-21cut19:40:144
2712799164,10cyclictest32565-21swap20:25:244
2712799160,9cyclictest23302-21sh22:38:554
2711999165,8cyclictest644-21dbus-daemon23:15:003
2711799163,9cyclictest27858-21tune2fs00:10:152
2711799163,11cyclictest19946-21fschecks_count20:00:122
2711799163,11cyclictest19946-21fschecks_count20:00:122
2711099163,9cyclictest8381-21netstat19:35:191
2711099163,9cyclictest4629-21seq21:18:481
2711099160,13cyclictest21561-21sh22:37:421
2710699161,7cyclictest28609-21awk20:20:000
2710699160,8cyclictest30065-21runrttasks23:53:370
2710699160,8cyclictest30065-21runrttasks23:53:360
2710699160,8cyclictest20118-21diskmemload00:36:570
225999160,9tDemoTimingTask2325-21taskset19:24:555
217299160,9tDemoTimingTask6156-21taskset23:05:005
1502929160,7tAtEmLog_015135-21taskset20:56:435
1176799161,12tDemoTimingTask13795-21chrt19:45:355
1176629160,10tAtEmLog_011771-21chrt19:44:415
2712799158,6cyclictest15327-21tr23:45:174
2712799157,7cyclictest27098-21cyclictest23:24:324
2712799150,11cyclictest29850-21ssh23:17:334
2712799150,11cyclictest20056-21diskmemload00:24:064
2711999153,8cyclictest327-21systemd-journal22:02:093
2711999152,9cyclictest831-21runrttasks20:04:233
2711999152,9cyclictest831-21runrttasks20:04:233
2711999151,7cyclictest18376-21ssh00:22:573
27119991511,3cyclictest3011-21cpuspeed_turbos21:35:183
27119991511,3cyclictest3011-21cpuspeed_turbos21:35:173
2711999151,11cyclictest16-1pr/legacy21:41:173
2711999151,10cyclictest6232-21/usr/sbin/munin20:40:173
2711999150,9cyclictest8532-21sh23:59:483
2711999150,9cyclictest5215-21ssh22:10:533
2711999150,9cyclictest14209-21sh00:02:243
2711999150,9cyclictest13445-21sh21:58:123
2711999150,9cyclictest13445-21sh21:58:123
2711799154,8cyclictest744-21snmpd22:44:132
2711799153,8cyclictest25475-21latency_hist22:05:002
2711799152,10cyclictest16-1pr/legacy22:21:512
2711799151,10cyclictest11664-21ssh22:32:212
2711799150,9cyclictest29773-21latency_hist19:15:002
2711099151,10cyclictest8680-21ssh23:59:531
2711099151,10cyclictest11892-21sh21:40:061
2711099150,9cyclictest6226-21ssh23:22:091
2711099150,12cyclictest27791-21vmstat22:05:261
2711099150,11cyclictest4003-21rm00:33:041
2711099150,10cyclictest831-21runrttasks23:02:071
2711099150,10cyclictest26602-21wget20:15:141
2710699156,7cyclictest5990-21sh22:11:270
2710699156,7cyclictest28831-21sensors_temp00:10:220
2710699156,7cyclictest20428-21ssh22:55:020
2710699153,9cyclictest11613-21sed21:40:000
2710699153,9cyclictest11613-21sed21:40:000
2710699151,10cyclictest29383-21sh22:41:480
27106991510,4cyclictest32140-21idleruntime-cro19:20:000
2710699150,12cyclictest175-1kworker/0:1H+kblockd19:20:350
2712799144,7cyclictest4219-21smartctl21:35:254
2712799144,7cyclictest4219-21smartctl21:35:254
2712799142,9cyclictest29288-21awk19:10:244
2712799141,9cyclictest32679-21diskmemload23:55:044
2712799141,9cyclictest2248-21ntp_kernel_pll_20:30:174
2712799141,9cyclictest20901-21cpu21:10:144
2712799141,9cyclictest14471-21runrttasks19:50:044
27127991411,2cyclictest0-21swapper/422:20:144
2712799140,12cyclictest8796-21ssh00:35:234
2712799140,11cyclictest4967-21sh22:46:024
2712799140,10cyclictest831-21runrttasks22:29:404
2712799140,10cyclictest7399-21memory23:05:174
2712799140,10cyclictest7293-21ssh00:16:274
2712799140,10cyclictest6616-21rm22:30:024
2712799140,10cyclictest6055-21sed23:05:004
2712799140,10cyclictest5454-21unixbench_multi20:35:284
2712799140,10cyclictest4328-21wc22:10:254
2712799140,10cyclictest32334-21sh23:36:274
2712799140,10cyclictest31862-21proc_pri21:50:204
2712799140,10cyclictest31862-21proc_pri21:50:204
2712799140,10cyclictest31497-21sensors_fan21:15:214
2712799140,10cyclictest30740-21ssh21:32:264
2712799140,10cyclictest29918-21sh23:53:314
2712799140,10cyclictest29918-21sh23:53:304
2712799140,10cyclictest29460-21ssh00:10:334
2712799140,10cyclictest28092-21sh22:05:384
2712799140,10cyclictest25631-21sh00:26:444
2712799140,10cyclictest22498-21sh21:28:114
2712799140,10cyclictest22130-21ssh23:30:364
2712799140,10cyclictest21829-21sh00:06:274
2712799140,10cyclictest20563-21sh22:55:094
2712799140,10cyclictest18545-21sh23:11:114
2712799140,10cyclictest17765-21sh21:42:564
2712799140,10cyclictest17001-21ssh22:53:034
2712799140,10cyclictest17000-21ssh23:28:194
2712799140,10cyclictest16973-21ssh00:04:214
2712799140,10cyclictest16836-21/usr/sbin/munin19:55:164
2712799140,10cyclictest16836-21/usr/sbin/munin19:55:164
2712799140,10cyclictest16410-21ssh22:17:154
2712799140,10cyclictest15726-21aten2_r5power_c21:00:134
2712799140,10cyclictest13708-21sh21:58:234
2712799140,10cyclictest13708-21sh21:58:234
2712799140,10cyclictest13041-21munin-run20:55:004
2712799140,10cyclictest12130-21/usr/sbin/munin19:45:134
2712799140,10cyclictest11405-21rm21:22:004
2711999146,6cyclictest731-21gdbus19:35:003
2711999145,7cyclictest30638-21tune2fs21:15:153
2711999144,8cyclictest14597-21/usr/sbin/munin20:55:243
2711999144,7cyclictest22784-21smartctl21:45:203
2711999143,6cyclictest11466-21tune2fs23:25:143
2711999141,9cyclictest831-21runrttasks00:19:013
2711999141,9cyclictest31233-21latency_hist20:25:013
2711999141,9cyclictest28292-21diskmemload21:14:123
2711999141,9cyclictest20689-21/usr/sbin/munin22:55:223
2711999141,9cyclictest18322-21unixbench_multi21:25:263
2711999141,9cyclictest15346-21diskmemload23:10:043
2711999141,9cyclictest14661-21/usr/sbin/munin23:45:283
2711999141,9cyclictest11502-21runrttasks19:41:213
2711999141,10cyclictest25059-21sh00:08:453
27119991410,3cyclictest7424-21unixbench_multi23:40:253
27119991410,3cyclictest717-21in:imuxsock19:50:003
2711999140,7cyclictest31992-21ssh23:00:373
2711999140,11cyclictest30511-21sh22:25:143
2711999140,10cyclictest9807-21rm21:20:593
2711999140,10cyclictest9454-21sh00:35:333
2711999140,10cyclictest831-21runrttasks23:22:303
2711999140,10cyclictest831-21runrttasks19:37:193
2711999140,10cyclictest6835-21ssh22:30:113
2711999140,10cyclictest6395-21ssh21:54:433
2711999140,10cyclictest6395-21ssh21:54:433
2711999140,10cyclictest6220-21ssh23:05:033
2711999140,10cyclictest31679-21sh00:30:173
2711999140,10cyclictest30983-21ssh22:07:363
2711999140,10cyclictest30968-21sh23:54:153
2711999140,10cyclictest30968-21sh23:54:153
2711999140,10cyclictest28581-21latency_hist20:20:013
2711999140,10cyclictest26062-21ssh22:22:353
2711999140,10cyclictest25764-21/usr/sbin/munin21:30:203
2711999140,10cyclictest23518-21sh22:39:053
2711999140,10cyclictest19938-21/usr/sbin/munin23:30:233
2711999140,10cyclictest1872-21sh22:45:003
2711999140,10cyclictest1197-21/usr/sbin/munin20:30:163
2711999140,10cyclictest11920-21tail22:50:143
2711999140,10cyclictest11876-21/usr/sbin/munin22:15:203
2711799146,6cyclictest644-21dbus-daemon19:30:202
2711799145,7cyclictest17063-21sort19:55:142
2711799145,7cyclictest17063-21sort19:55:142
2711799141,9cyclictest7703-21df19:35:142
2711799141,9cyclictest3605-21/usr/sbin/munin21:35:202
2711799141,9cyclictest3605-21/usr/sbin/munin21:35:202
2711799141,9cyclictest25077-21ssh21:12:022
2711799141,9cyclictest18262-21sh00:05:042
2711799141,10cyclictest831-21runrttasks23:19:342
2711799141,10cyclictest16068-21df_inode21:00:152
2711799140,9cyclictest21829-21fschecks_count21:45:142
2711799140,8cyclictest20569-21taskset23:12:352
2711799140,12cyclictest16342-21ssh21:25:092
2711799140,10cyclictest9900-21ssh23:42:072
2711799140,10cyclictest807-21postgres00:16:472
2711799140,10cyclictest7281-21ssh21:55:072
2711799140,10cyclictest7281-21ssh21:55:072
2711799140,10cyclictest5853-21sh23:57:552
2711799140,10cyclictest32674-21sh23:36:402
2711799140,10cyclictest32562-21ssh21:33:412
2711799140,10cyclictest32187-21apt-config23:55:002
2711799140,10cyclictest32187-21apt-config23:55:002
2711799140,10cyclictest3146-21runrttasks20:33:452
2711799140,10cyclictest3092-21sh00:32:252
2711799140,10cyclictest28934-21/usr/sbin/munin20:20:242
2711799140,10cyclictest2135-21/usr/sbin/munin22:45:242
2711799140,10cyclictest19407-21sh22:36:142
2711799140,10cyclictest16174-21sh23:45:262
2711799140,10cyclictest15244-21chrt20:58:102
2711799140,10cyclictest14786-21sh23:09:542
2711799140,10cyclictest13886-21ssh21:23:432
2711799140,10cyclictest13684-21ssh23:26:002
2711799140,10cyclictest13552-21ssh00:01:572
2711799140,10cyclictest10032-21ssh23:24:502
2711099141,9cyclictest22071-21diskmemload23:30:331
2711099141,9cyclictest11876-21/usr/sbin/munin22:15:221
2711099141,9cyclictest10571-21runrttasks20:48:351
2711099141,10cyclictest19031-21runrttasks23:11:311
2711099141,10cyclictest13195-21runrttasks00:38:151
2711099140,10cyclictest9640-21ssh00:18:061
2711099140,10cyclictest9374-21ssh21:55:261
2711099140,10cyclictest9374-21ssh21:55:261
2711099140,10cyclictest9057-21sh22:30:361
2711099140,10cyclictest8871-40mandb00:00:021
2711099140,10cyclictest831-21runrttasks21:11:131
2711099140,10cyclictest831-21runrttasks20:53:361
2711099140,10cyclictest831-21runrttasks19:33:551
2711099140,10cyclictest831-21runrttasks00:14:331
2711099140,10cyclictest7756-21sh23:05:201
2711099140,10cyclictest6973-21/usr/sbin/munin21:20:161
2711099140,10cyclictest6580-21df20:40:141
2711099140,10cyclictest6133-21fschecks_time23:40:151
2711099140,10cyclictest4959-21diskmemload22:10:441
2711099140,10cyclictest4278-21ssh22:45:331
2711099140,10cyclictest3731-21rm20:35:011
2711099140,10cyclictest31874-21ssh21:50:201
2711099140,10cyclictest31874-21ssh21:50:201
2711099140,10cyclictest31388-21open_inodes22:25:201
2711099140,10cyclictest30024-21/usr/sbin/munin19:15:201
2711099140,10cyclictest28988-21runintdemo5min20:20:121
2711099140,10cyclictest28718-21ssh23:35:011
2711099140,10cyclictest28542-21cut19:10:171
2711099140,10cyclictest2748-21/usr/sbin/munin21:35:201
2711099140,10cyclictest2748-21/usr/sbin/munin21:35:201
2711099140,10cyclictest27227-21sensors_volt21:30:211
2711099140,10cyclictest27128-21gpgv19:10:001
2711099140,10cyclictest26838-21sh23:15:261
2711099140,10cyclictest26017-21runrttasks20:12:251
2711099140,10cyclictest25435-21/usr/sbin/munin22:40:211
2711099140,10cyclictest23928-21tr23:50:141
2711099140,10cyclictest23928-21tr23:50:141
2711099140,10cyclictest23596-21taskset20:06:291
2711099140,10cyclictest23442-21sh21:45:311
2711099140,10cyclictest23274-21awk00:25:221
2711099140,10cyclictest22891-21ssh22:55:371
2711099140,10cyclictest20961-21ssh21:27:091
2711099140,10cyclictest20884-21sh00:05:481
2711099140,10cyclictest20820-21ssh22:20:051
2711099140,10cyclictest19882-21forks20:00:121
2711099140,10cyclictest19882-21forks20:00:121
2711099140,10cyclictest19322-21python321:05:231
2711099140,10cyclictest18467-21ssh23:46:471
2711099140,10cyclictest17930-21cat21:05:001
2711099140,10cyclictest16845-21cat19:55:131
2711099140,10cyclictest16845-21cat19:55:131
2711099140,10cyclictest16573-21ssh22:00:081
2711099140,10cyclictest14179-21ssh00:20:211
2711099140,10cyclictest1269-21grep19:20:191
2711099140,10cyclictest12452-21expr19:45:141
2711099140,10cyclictest11013-21ssh22:50:021
2711099140,10cyclictest10707-21sh23:25:031
2710699147,5cyclictest14176-21cron19:50:000
2710699146,6cyclictest31149-21sh23:35:350
2710699143,8cyclictest327-21systemd-journal00:34:090
2710699143,8cyclictest16073-21unixbench_singl19:50:240
2710699142,9cyclictest754-21ntpd20:10:230
2710699142,7cyclictest18199-21ssh23:10:550
2710699141,9cyclictest9256-21diskmemload23:41:400
2710699141,9cyclictest6493-21timerwakeupswit19:30:240
2710699141,9cyclictest30106-21sh22:07:000
2710699141,10cyclictest21588-21latency_hist20:05:000
2710699141,10cyclictest21588-21latency_hist20:05:000
2710699140,8cyclictest29064-21sh21:31:180
2710699140,7cyclictest3493-21ssh23:56:120
2710699140,7cyclictest3279-21ssh23:20:210
2710699140,7cyclictest18133-21sensors22:00:220
2710699140,12cyclictest7857-21ssh23:05:200
2710699140,12cyclictest4453-21grep00:15:160
2710699140,12cyclictest22995-21sh22:20:280
2710699140,12cyclictest12675-21basename22:15:190
2710699140,12cyclictest10722-21netstat00:00:200
2710699140,10cyclictest8464-21python321:20:200
2710699140,10cyclictest831-21runrttasks22:45:310
2710699140,10cyclictest831-21runrttasks21:10:020
2710699140,10cyclictest831-21runrttasks21:06:090
2710699140,10cyclictest831-21runrttasks21:02:500
2710699140,10cyclictest831-21runrttasks19:56:470
2710699140,10cyclictest831-21runrttasks19:56:470
2710699140,10cyclictest8051-21rm21:55:140
2710699140,10cyclictest8051-21rm21:55:140
2710699140,10cyclictest744-21snmpd19:28:530
2710699140,10cyclictest417-21sh21:50:400
2710699140,10cyclictest417-21sh21:50:400
2710699140,10cyclictest343-21sh22:25:560
2710699140,10cyclictest30094-21aten2_r5power_c21:15:130
2710699140,10cyclictest29742-21latency20:20:170
2710699140,10cyclictest29487-21ssh23:00:000
2710699140,10cyclictest24722-21rm00:08:320
2710699140,10cyclictest18472-21ssh21:25:290
2710699140,10cyclictest15316-21sh00:20:460
2710699140,10cyclictest14920-21rm23:26:530
111499140,11tDemoTimingTask7831-21chrt00:16:515
666329135,0tAtEmLog_00-21swapper/522:51:285
2939999130,11tDemoTimingTask5567-21taskset23:57:415
2712799130,9cyclictest831-21runrttasks20:08:454
2712799130,9cyclictest744-21snmpd20:40:044
2712799130,9cyclictest7345-21runrttasks19:35:064
2712799130,9cyclictest5001-21/usr/sbin/munin19:30:134
2712799130,9cyclictest32570-21apt-key19:20:004
2712799130,9cyclictest30720-21runrttasks20:21:584
2712799130,9cyclictest30276-21cpuspeed_turbos19:15:144
2712799130,9cyclictest2956-21cpuspeed_turbos19:25:154
2712799130,9cyclictest27234-21cat19:09:594
2712799130,9cyclictest26523-21runintdemo5min20:15:064
2712799130,9cyclictest19511-21/usr/sbin/munin20:00:104
2712799130,9cyclictest19511-21/usr/sbin/munin20:00:104
2712799130,9cyclictest18043-21sh22:00:214
2712799130,9cyclictest13336-21runrttasks20:55:104
2712799130,8cyclictest831-21runrttasks20:45:094
2712799130,8cyclictest25010-21latency20:10:214
2711999131,9cyclictest24580-21df_inode20:10:183
2711999130,9cyclictest8644-21wget20:45:133
2711999130,9cyclictest3858-21/usr/sbin/munin20:35:143
2711999130,9cyclictest32701-21/usr/sbin/munin19:20:143
2711999130,9cyclictest31253-21/usr/sbin/munin20:25:143
2711999130,9cyclictest30737-21timerwakeupswit23:35:283
2711999130,9cyclictest3007-21diskstats19:25:163
2711999130,9cyclictest30055-21aten2_r5power_c19:15:133
2711999130,9cyclictest21921-21/usr/sbin/munin00:25:233
2711999130,9cyclictest21864-21/usr/sbin/munin20:05:143
2711999130,9cyclictest18110-21aten2_r5power_e21:05:143
2711999130,9cyclictest16824-21runrttasks19:55:043
2711999130,9cyclictest16824-21runrttasks19:55:043
2711999130,9cyclictest15713-21/usr/sbin/munin21:00:223
2711999130,9cyclictest10988-21/usr/sbin/munin20:50:213
2711999130,10cyclictest27503-21apt-key19:10:003
2711999130,10cyclictest27410-21ssh00:10:143
2711999130,10cyclictest25851-21df_inode22:40:153
2711799139,3cyclictest13477-21fschecks_time00:20:162
2711799136,5cyclictest26444-21sort22:05:162
2711799131,9cyclictest604-21df_inode19:20:152
2711799131,9cyclictest25901-21runrttasks20:10:522
2711799130,9cyclictest8745-21chrt20:45:142
2711799130,9cyclictest7043-21sh00:35:022
2711799130,9cyclictest31737-21runrttasks19:16:142
2711799130,9cyclictest31253-21/usr/sbin/munin20:25:132
2711799130,9cyclictest30865-21diskmemload21:15:172
2711799130,9cyclictest30111-21/usr/sbin/munin22:25:142
2711799130,9cyclictest26914-21cstates20:15:152
2711799130,9cyclictest2654-21atemtest19:25:142
2711799130,9cyclictest2606-21/usr/sbin/munin22:10:152
2711799130,9cyclictest21864-21/usr/sbin/munin20:05:112
2711799130,9cyclictest18057-21runrttasks21:05:052
2711799130,9cyclictest1803-21sh23:02:112
2711799130,9cyclictest15841-21wc19:50:232
2711799130,9cyclictest15173-21ssh22:16:252
2711799130,9cyclictest10988-21/usr/sbin/munin20:50:132
2711799130,8cyclictest12567-21fschecks_count19:45:152
2711799130,10cyclictest6753-21tune2fs20:40:172
2711799130,10cyclictest327-21systemd-journal21:50:142
2711799130,10cyclictest327-21systemd-journal21:50:132
2711799130,10cyclictest20689-21/usr/sbin/munin22:55:192
2711799130,10cyclictest12681-21sensors_temp22:50:192
2711799130,10cyclictest10719-21missed_timers19:40:172
2711099130,9cyclictest2810-21grep19:25:141
2711099130,9cyclictest14942-21unixbench_singl20:55:261
2711099130,9cyclictest11741-21chrt19:44:371
2711099130,10cyclictest31508-21expr20:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional