You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 00:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Dec 24, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1455039920,0EcMasterDemoSyn1456029tAtEmLog_011:58:295
3274839910,0EcMasterDemoSyn3275829tAtEmLog_012:08:395
3274839910,0EcMasterDemoSyn3275829tAtEmLog_012:08:385
42782900,0sleep30-21swapper/309:31:013
988839830,0EcMasterDemoSyn989829tAtEmLog_007:24:395
1950039830,0EcMasterDemoSyn1951229tAtEmLog_009:56:485
1700439830,0EcMasterDemoSyn1701429tAtEmLog_007:39:525
1273139830,0EcMasterDemoSyn1274129tAtEmLog_008:35:395
801539820,0EcMasterDemoSyn802529tAtEmLog_008:25:315
2016439820,0EcMasterDemoSyn2017429tAtEmLog_011:07:475
1511139820,0EcMasterDemoSyn1512129tAtEmLog_008:40:435
884439810,0EcMasterDemoSyn885429tAtEmLog_009:16:145
118722590,3sleep00-21swapper/010:28:080
1093639220,1EcMasterDemoSyn10943-21grep11:02:421
1321439200,0EcMasterDemoSyn0-21swapper/412:33:594
2617991911,6cyclictest24613-21grep11:10:150
261799190,10cyclictest831-21runrttasks12:04:480
1521399190,11tDemoTimingTask15237-21chrt11:23:005
2935729180,0tAtEmLog_00-21swapper/510:42:245
261799180,5cyclictest175-1kworker/0:1H+kblockd11:30:180
261799180,14cyclictest18062-21sh09:39:030
261799180,10cyclictest2919-21rm09:48:050
261799180,10cyclictest20893-21sh11:25:350
114692180,0sleep00-21swapper/011:03:030
263399178,7cyclictest14687-21cron12:35:003
262399179,6cyclictest29692-21grep11:30:281
261799174,11cyclictest1090-21cut10:40:010
261799171,14cyclictest29208-21fschecks_count09:10:140
261799170,9cyclictest5303-21sh12:10:460
261799170,9cyclictest3345-21sh11:16:020
261799170,9cyclictest18838-21ssh11:06:510
261799170,9cyclictest13776-21ssh09:19:320
261799170,9cyclictest13233-21ssh10:45:460
2552199170,7tDemoTimingTask26150-21taskset09:05:095
2458239170,0EcMasterDemoSyn0-21swapper/507:55:055
74299160,9tDemoTimingTask6009-21taskset09:50:015
263999160,12cyclictest16-1pr/legacy11:43:154
263399164,8cyclictest3231-21aten2_r5power_e07:10:103
262799164,8cyclictest15772-21latency_hist08:45:002
262399168,6cyclictest8904-21grep07:20:211
2623991612,3cyclictest734-21runintdemo5min09:46:391
261799160,9cyclictest831-21runrttasks08:42:110
261799160,9cyclictest12034-21sh11:20:450
261799160,8cyclictest831-21runrttasks08:25:530
261799160,13cyclictest831-21runrttasks12:34:070
261799160,13cyclictest12638-21if_err_enp5s012:15:150
261799160,10cyclictest31755-21ssh10:20:490
2370599160,9tDemoTimingTask23826-21taskset12:03:375
112799160,9tDemoTimingTask1135-21chrt11:33:085
1094629160,9tAtEmLog_014141-21taskset11:04:565
551399150,9tDemoTimingTask31184-21sleep11:54:565
263999155,8cyclictest11249-21/usr/sbin/munin10:10:154
2639991512,2cyclictest23338-21cron11:09:594
263999150,9cyclictest19908-21ssh10:15:074
263999150,9cyclictest19908-21ssh10:15:064
263999150,10cyclictest14370-21rm11:22:254
263399151,10cyclictest771-21sshd10:55:023
263399151,10cyclictest24550-21fschecks_time11:10:153
263399151,10cyclictest24346-21runrttasks12:21:333
263399150,9cyclictest29367-21sh10:02:123
263399150,11cyclictest8912-21sh11:19:553
263399150,11cyclictest4189-21cpuspeed08:20:123
263399150,11cyclictest4189-21cpuspeed08:20:123
263399150,11cyclictest21361-21ssh11:08:363
263399150,11cyclictest19184-21ssh10:14:483
263399150,11cyclictest11732-21sh11:20:333
263399150,10cyclictest19427-21ls10:50:003
262799151,10cyclictest4155-21sh11:52:282
262799151,10cyclictest24614-21sh11:28:122
262799150,10cyclictest6631-21ssh10:07:322
262399152,9cyclictest14434-21ssh12:15:541
2623991511,3cyclictest32693-21needreboot08:10:191
262399151,10cyclictest25953-21ssh09:43:011
261799155,8cyclictest21835-21chrt10:33:270
261799152,9cyclictest22287-21atemtest07:50:110
261799151,9cyclictest831-21runrttasks09:57:260
2617991511,3cyclictest23821-21head09:41:340
261799151,10cyclictest7375-21rm10:43:140
261799150,8cyclictest11423-21sh11:56:160
261799150,13cyclictest2770-21proc_pri09:30:200
261799150,11cyclictest327-21systemd-journal07:55:210
15716291514,0tAtEmLog_00-21swapper/510:50:005
1505399152,5tDemoTimingTask19475-21turbostat10:15:005
607299140,7tDemoTimingTask8452-21taskset11:19:365
263999148,4cyclictest16-1pr/legacy11:58:284
263999144,8cyclictest26777-21/usr/sbin/munin12:05:154
263999144,8cyclictest26777-21/usr/sbin/munin12:05:154
263999143,8cyclictest332-21ssh09:29:424
263999143,8cyclictest24958-21cut10:00:154
263999143,7cyclictest21544-21kworker/u24:2+nfsiod11:00:054
263999141,9cyclictest6374-21sh11:18:084
263999141,9cyclictest4195-21sh11:35:054
263999141,9cyclictest2023-21diskmemload09:47:284
2639991411,2cyclictest327-21systemd-journal10:30:004
263999141,10cyclictest15211-21sh10:30:044
2639991410,3cyclictest19568-21munin-plugin-st09:40:004
263999140,9cyclictest31735-21runrttasks10:55:584
263999140,9cyclictest18379-21sh09:56:054
263999140,12cyclictest3798-21ssh10:40:464
263999140,10cyclictest831-21runrttasks10:39:194
263999140,10cyclictest8265-21rm09:33:434
263999140,10cyclictest7950-21sed09:50:244
263999140,10cyclictest7591-21latency_hist07:20:004
263999140,10cyclictest6223-21ssh10:07:134
263999140,10cyclictest29521-21ssh09:10:154
263999140,10cyclictest29114-21rm12:24:584
263999140,10cyclictest22618-21ssh12:39:164
263399141,9cyclictest9204-21sh12:13:353
263399141,9cyclictest32503-21diskmemload12:08:273
263399141,9cyclictest32503-21diskmemload12:08:273
263399141,9cyclictest23936-21diskmemload09:41:393
263399141,9cyclictest18090-21sh10:30:553
263399141,9cyclictest14818-21latency_hist07:35:003
263399141,10cyclictest20277-21runrttasks08:51:403
263399140,9cyclictest5567-21sh10:06:503
263399140,5cyclictest21507-21ssh10:15:223
263399140,5cyclictest21507-21ssh10:15:213
263399140,11cyclictest10006-21awk08:30:593
263399140,10cyclictest9060-21sh09:51:003
263399140,10cyclictest8430-21sh10:25:463
263399140,10cyclictest831-21runrttasks09:57:163
263399140,10cyclictest8204-21ssh11:55:073
263399140,10cyclictest815-21sh09:12:063
263399140,10cyclictest7960-21ssh09:15:373
263399140,10cyclictest744-21snmpd11:32:033
263399140,10cyclictest7179-21ssh11:36:033
263399140,10cyclictest5868-21ssh11:00:133
263399140,10cyclictest536-21ssh09:46:323
263399140,10cyclictest453-21grep08:10:213
263399140,10cyclictest31973-21sh12:25:383
263399140,10cyclictest31527-21ssh11:50:043
263399140,10cyclictest24997-21cut09:25:163
263399140,10cyclictest24648-21/usr/sbin/munin10:35:153
263399140,10cyclictest23899-21cut09:00:143
263399140,10cyclictest23032-21ssh10:51:133
263399140,10cyclictest22737-21/usr/sbin/munin11:45:173
263399140,10cyclictest22675-21grep07:50:133
263399140,10cyclictest2192-21head08:15:163
263399140,10cyclictest18875-21sh12:36:363
263399140,10cyclictest17883-21diskstats07:40:133
263399140,10cyclictest16721-21sh09:20:273
263399140,10cyclictest1505-21ssh10:22:173
263399140,10cyclictest1350-21/usr/sbin/munin10:40:153
263399140,10cyclictest13343-21/usr/sbin/munin11:40:123
263399140,10cyclictest11779-21/usr/sbin/munin12:15:113
263399140,10cyclictest10831-21/usr/sbin/munin09:35:193
263399140,10cyclictest10262-21/usr/sbin/munin07:25:203
262799142,9cyclictest10884-21grep10:10:132
262799141,9cyclictest644-21dbus-daemon09:33:192
262799141,9cyclictest31177-21runrttasks08:07:412
262799141,9cyclictest2871-21/usr/sbin/munin08:15:212
262799141,9cyclictest27769-21sh12:24:002
262799141,9cyclictest20791-21diskmemload09:57:392
262799141,9cyclictest14315-21runrttasks07:31:002
262799141,10cyclictest16-1pr/legacy08:20:252
262799141,10cyclictest16-1pr/legacy08:20:252
262799140,10cyclictest9123-21basename11:55:172
262799140,10cyclictest864-21runintdemo5min09:36:302
262799140,10cyclictest8359-21ssh12:30:292
262799140,10cyclictest831-21runrttasks12:36:412
262799140,10cyclictest831-21runrttasks11:30:232
262799140,10cyclictest831-21runrttasks10:19:022
262799140,10cyclictest831-21runrttasks10:19:022
262799140,10cyclictest6581-21ssh11:35:382
262799140,10cyclictest6234-21sh10:42:282
262799140,10cyclictest5551-21ssh11:00:042
262799140,10cyclictest5534-21/usr/sbin/munin07:15:212
262799140,10cyclictest472-21/usr/sbin/munin11:15:182
262799140,10cyclictest32444-21sh09:46:092
262799140,10cyclictest31354-21sed12:25:242
262799140,10cyclictest30575-21sh12:07:042
262799140,10cyclictest30575-21sh12:07:042
262799140,10cyclictest3028-21rm10:58:302
262799140,10cyclictest29123-21sh10:02:022
262799140,10cyclictest28751-21/usr/sbin/munin09:10:242
262799140,10cyclictest2675-21ssh12:10:042
262799140,10cyclictest26136-21python310:35:232
262799140,10cyclictest25172-21sh09:42:292
262799140,10cyclictest24306-21df_inode11:10:142
262799140,10cyclictest23802-21/usr/sbin/munin09:00:172
262799140,10cyclictest22737-21/usr/sbin/munin11:45:212
262799140,10cyclictest21156-21/usr/sbin/munin08:55:152
262799140,10cyclictest20843-21grep10:50:182
262799140,10cyclictest19463-21runrttasks07:43:362
262799140,10cyclictest17830-21chrt08:46:092
262799140,10cyclictest17392-21ssh11:24:312
262799140,10cyclictest17252-21sh12:00:102
262799140,10cyclictest16195-21expr10:30:162
262799140,10cyclictest15472-21ssh11:40:312
262799140,10cyclictest14679-21rm11:05:072
262799140,10cyclictest14673-21ssh10:46:472
262799140,10cyclictest13086-21rm09:53:452
262799140,10cyclictest11408-21ssh10:27:502
262399145,8cyclictest10018-21/usr/sbin/munin11:55:251
262399145,7cyclictest16529-21ssh10:13:001
262399143,8cyclictest744-21snmpd07:59:371
262399143,8cyclictest648-21systemd-logind07:39:171
262399141,9cyclictest9235-21sh12:13:351
262399141,9cyclictest831-21runrttasks09:58:021
262399141,9cyclictest831-21runrttasks07:44:131
262399141,10cyclictest12927-21runrttasks08:37:501
262399140,10cyclictest9960-21ssh09:16:571
262399140,10cyclictest8722-21ssh10:08:571
262399140,10cyclictest7557-21ssh11:36:191
262399140,10cyclictest6341-21/usr/sbin/munin08:25:211
262399140,10cyclictest6336-21/usr/sbin/munin12:30:241
262399140,10cyclictest5946-21/usr/sbin/munin10:25:201
262399140,10cyclictest5703-21runrttasks08:20:331
262399140,10cyclictest5703-21runrttasks08:20:321
262399140,10cyclictest5534-21/usr/sbin/munin07:15:211
262399140,10cyclictest32398-21/usr/sbin/munin11:50:141
262399140,10cyclictest3237-21aten2_r5power_e07:10:101
262399140,10cyclictest32172-21taskset10:04:081
262399140,10cyclictest31103-21sendmail_mailqu12:25:201
262399140,10cyclictest30493-21ssh10:20:191
262399140,10cyclictest29284-21sh11:48:411
262399140,10cyclictest27854-21runintdemo5min09:26:221
262399140,10cyclictest27531-21grep12:23:511
262399140,10cyclictest27080-21rm10:18:561
262399140,10cyclictest27080-21rm10:18:551
262399140,10cyclictest2695-21ssh09:30:201
262399140,10cyclictest23917-21ssh11:10:111
262399140,10cyclictest22215-21sh10:50:391
262399140,10cyclictest22204-21latency_hist07:50:001
262399140,10cyclictest20531-21apt-get08:55:001
262399140,10cyclictest17251-21ssh12:35:291
262399140,10cyclictest15956-21apt-config08:45:011
262399140,10cyclictest15894-21ssh10:47:361
262399140,10cyclictest15465-21cron08:45:001
262399140,10cyclictest14215-21rm09:36:281
262399140,10cyclictest1360-21ssh10:57:231
262399140,10cyclictest10750-21latency_hist08:35:001
261799141,9cyclictest4279-21diskmemload11:52:340
261799141,10cyclictest23961-21ntp_kernel_pll_11:45:200
261799140,8cyclictest18394-21memory07:40:170
261799140,7cyclictest831-21runrttasks07:12:230
261799140,7cyclictest3362-21/usr/sbin/munin10:05:230
261799140,7cyclictest24979-21aten2_r5power_v10:00:160
261799140,12cyclictest8182-21/usr/sbin/munin09:50:250
261799140,12cyclictest22491-21taskset10:15:460
261799140,12cyclictest22491-21taskset10:15:450
261799140,11cyclictest831-21runrttasks08:45:120
261799140,10cyclictest8961-21cpuspeed08:30:520
261799140,10cyclictest831-21runrttasks12:36:090
261799140,10cyclictest831-21runrttasks09:06:330
261799140,10cyclictest831-21runrttasks08:56:100
261799140,10cyclictest831-21runrttasks07:48:070
261799140,10cyclictest831-21runrttasks07:25:210
261799140,10cyclictest4626-21ssh11:35:140
261799140,10cyclictest30591-21if_enp5s012:25:170
261799140,10cyclictest29885-21sh10:55:170
261799140,10cyclictest28612-21sh12:05:410
261799140,10cyclictest28612-21sh12:05:400
261799140,10cyclictest26298-21unixbench-2d09:25:250
261799140,10cyclictest21155-21diskmemload10:50:200
261799140,10cyclictest21061-21cpuspeed_turbos12:20:140
261799140,10cyclictest18317-21sh09:21:180
261799140,10cyclictest13165-21rm11:40:020
261799140,10cyclictest12936-21ssh10:10:320
2496929146,0tAtEmLog_00-21swapper/510:52:365
1777799140,7tDemoTimingTask17826-21taskset08:46:065
1051099140,8tDemoTimingTask10528-21taskset10:27:135
989829130,2tAtEmLog_012008-21chrt07:26:405
3253499130,11tDemoTimingTask2334-21chrt07:07:435
2935999131,10tDemoTimingTask32680-21chrt10:39:395
2881729130,2tAtEmLog_030290-21chrt11:49:235
2786699130,10tDemoTimingTask3599-21chrt09:30:335
263999132,8cyclictest26216-21tr09:05:114
263999131,6cyclictest29803-21aten2_r5power_c12:25:144
263999130,9cyclictest8697-21taskset08:30:144
263999130,9cyclictest6746-21fschecks_count08:25:154
263999130,9cyclictest5499-21ssh09:15:034
263999130,9cyclictest4969-21taskset07:12:164
263999130,9cyclictest3989-21/usr/sbin/munin08:20:184
263999130,9cyclictest3989-21/usr/sbin/munin08:20:184
263999130,9cyclictest31853-21chrt10:20:534
263999130,9cyclictest29307-21/usr/sbin/munin08:05:224
263999130,9cyclictest29262-21latency_hist08:05:004
263999130,9cyclictest27638-21sh11:30:074
263999130,9cyclictest24630-21/usr/sbin/munin07:55:134
263999130,9cyclictest23802-21/usr/sbin/munin09:00:224
263999130,9cyclictest21134-21grep07:45:204
263999130,9cyclictest20804-21ssh11:25:314
263999130,9cyclictest20058-21sh09:40:094
263999130,9cyclictest19765-21sh10:50:044
263999130,9cyclictest18902-21fschecks_count08:50:144
263999130,9cyclictest17264-21ssh12:00:114
263999130,9cyclictest17007-21cut07:44:554
263999130,9cyclictest16089-21basename08:45:124
263999130,9cyclictest1601-21/usr/sbin/munin08:15:134
263999130,9cyclictest15669-21fschecks_time09:20:164
263999130,9cyclictest14969-21/usr/sbin/munin07:35:154
263999130,9cyclictest14800-21sh12:16:104
263999130,9cyclictest1476-21chrt11:50:354
263999130,9cyclictest13571-21ssh10:46:014
263999130,9cyclictest13420-21/usr/sbin/munin08:40:244
263999130,9cyclictest12618-21/usr/sbin/munin07:30:184
263999130,9cyclictest11835-21latency08:35:164
263999130,8cyclictest22750md0_raid111:45:354
263999130,10cyclictest9735-21taskset07:22:444
263999130,10cyclictest2637-21sh12:10:034
263999130,10cyclictest23842-21ssh11:10:094
263999130,10cyclictest22838-21cut08:55:564
263999130,10cyclictest11614-21cat07:25:244
263399135,6cyclictest17125-21ntpq08:45:203
263399130,9cyclictest831-21runrttasks08:55:043
263399130,9cyclictest7907-21taskset07:20:093
263399130,9cyclictest7594-21sensors_volt08:25:203
263399130,9cyclictest5781-21cpuspeed_turbos07:15:133
263399130,9cyclictest31241-21chrt08:08:333
263399130,9cyclictest27968-21chrt09:06:563
263399130,9cyclictest26995-21/usr/sbin/munin08:00:173
263399130,9cyclictest19926-21/usr/sbin/munin07:45:143
263399130,9cyclictest18410-21sh11:25:013
263399130,9cyclictest15222-21runrttasks08:41:433
263399130,10cyclictest771-21sshd07:35:193
263399130,10cyclictest26518-21taskset07:58:353
263399130,10cyclictest17274-21/usr/sbin/munin12:00:203
262799139,3cyclictest27592-21gltestperf08:00:152
262799135,6cyclictest644-21dbus-daemon09:20:212
262799130,9cyclictest831-21runrttasks08:30:062
262799130,9cyclictest831-21runrttasks08:00:002
262799130,9cyclictest831-21runrttasks07:35:212
262799130,9cyclictest744-21snmpd08:25:102
262799130,9cyclictest5724-21/usr/sbin/munin09:15:252
262799130,9cyclictest31316-21ssh10:20:312
262799130,9cyclictest2637-21apt-key07:10:002
262799130,9cyclictest25745-21open_files09:25:202
262799130,9cyclictest11792-21interrupts08:35:162
262799130,9cyclictest11587-21sh12:15:022
262799130,9cyclictest10262-21/usr/sbin/munin07:25:132
262799130,10cyclictest831-21runrttasks09:08:492
262799130,10cyclictest4495-21switchtime07:10:212
262799130,10cyclictest32010-21df08:10:142
262799130,10cyclictest23336-21ntp_kernel_pll_07:50:182
262799130,10cyclictest20619-21cat07:45:162
262799130,10cyclictest19711-21grep08:50:192
262399130,9cyclictest8428-21ssh09:50:341
262399130,9cyclictest748-21sh11:15:121
262399130,9cyclictest3328-21runrttasks08:15:341
262399130,9cyclictest30192-21latency08:05:181
262399130,9cyclictest28652-21sh09:10:071
262399130,9cyclictest27223-21ls08:00:131
262399130,9cyclictest26327-21/usr/sbin/munin12:05:251
262399130,9cyclictest26327-21/usr/sbin/munin12:05:241
262399130,9cyclictest26151-21/usr/sbin/munin09:05:171
262399130,9cyclictest24230-21fschecks_count09:00:161
262399130,9cyclictest21134-21/usr/sbin/munin08:55:221
262399130,9cyclictest20995-21sh11:25:391
262399130,9cyclictest18856-21ssh12:00:241
262399130,9cyclictest1817-21grep10:40:141
262399130,9cyclictest17590-21ssh11:06:011
262399130,9cyclictest16417-21sh11:41:121
262399130,9cyclictest15095-21/usr/sbin/munin09:20:201
262399130,9cyclictest14332-21runrttasks07:31:151
262399130,9cyclictest10262-21/usr/sbin/munin07:25:211
262399130,10cyclictest9516-21ssh11:20:071
262399130,10cyclictest25534-21ssh10:35:181
262399130,10cyclictest23983-21taskset07:51:061
262399130,10cyclictest15043-21apt-config10:30:001
261799131,9cyclictest15112-21cpu07:35:130
261799131,10cyclictest831-21runrttasks08:36:380
261799130,9cyclictest831-21runrttasks08:20:070
261799130,9cyclictest831-21runrttasks08:20:070
261799130,9cyclictest6957-21cat07:15:260
261799130,7cyclictest175-1kworker/0:1H+kblockd08:05:360
261799130,7cyclictest175-1kworker/0:1H+kblockd08:02:090
261799130,11cyclictest3386-21postgres08:16:210
261799130,10cyclictest9620-21taskset07:21:100
261799130,10cyclictest831-21runrttasks09:00:160
261799130,10cyclictest831-21runrttasks08:10:390
261799130,10cyclictest18648-21sort08:50:120
261799130,10cyclictest13790-21awk07:30:210
2552199130,11tDemoTimingTask25558-21chrt09:01:095
1701599130,7tDemoTimingTask19442-21taskset07:43:195
874699120,10tDemoTimingTask10727-21chrt08:34:525
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional