You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 05:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Wed Jun 10, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
729739830,0EcMasterDemoSyn730729tAtEmLog_023:12:225
2999639830,0EcMasterDemoSyn3000729tAtEmLog_023:42:485
2703939830,0EcMasterDemoSyn2704929tAtEmLog_021:36:015
666739820,0EcMasterDemoSyn667729tAtEmLog_023:47:535
2854339820,0EcMasterDemoSyn2855329tAtEmLog_019:34:205
260239820,0EcMasterDemoSyn261229tAtEmLog_023:27:355
2304739810,0EcMasterDemoSyn2305729tAtEmLog_020:30:075
259482340,4sleep225900-21kworker/u24:1+flush-9:019:26:142
2591239270,1EcMasterDemoSyn25920-21runintdemo5min23:22:312
16547992421,2cyclictest12667-21kworker/2:0+events20:13:432
472839230,0EcMasterDemoSyn0-21swapper/220:55:282
16552992220,2cyclictest12845-21kworker/3:0+events20:31:543
16538992220,2cyclictest23050irq/32-nvkm20:58:580
1653899220,14cyclictest780-21runrttasks22:09:400
16558992118,2cyclictest7956-21kworker/4:2+events00:33:504
202792200,0sleep10-21swapper/122:25:241
16543991910,7cyclictest21308-21tr23:20:131
2592399180,8tDemoTimingTask27825-21chrt23:23:515
16552991815,2cyclictest12845-21kworker/3:0+events23:15:063
1653899185,10cyclictest15027-21sh21:30:120
1653899181,14cyclictest670-21runrttasks21:40:030
1653899180,9cyclictest780-21runrttasks22:29:130
1653899180,10cyclictest8044-21sh22:36:480
382599170,15tDemoTimingTask8510-21chrt21:44:245
3127899170,10tDemoTimingTask32210-21chrt20:49:565
2496799170,7tDemoTimingTask29173-21chrt00:00:165
2148299170,9tDemoTimingTask25642-21chrt23:04:595
16547991714,2cyclictest12667-21kworker/2:0+events20:04:182
1654399179,6cyclictest21570-21grep20:25:171
1653899170,9cyclictest27882-21sh23:23:530
1653899170,9cyclictest13904-21sh23:34:110
1653899170,9cyclictest12216-21ssh22:57:050
1653899170,7cyclictest7113-21ssh00:05:330
1653899170,7cyclictest7113-21ssh00:05:320
1653899170,14cyclictest16103-21sh00:29:100
118299170,10tDemoTimingTask1379-21chrt19:45:005
1094399170,7tDemoTimingTask13004-21chrt20:06:045
1094399170,7tDemoTimingTask10987-21chrt20:04:585
3063799160,10tDemoTimingTask1914-21chrt23:09:555
2496799160,6tDemoTimingTask27568-21chrt23:59:515
2260029160,9tAtEmLog_022701-21chrt21:15:485
16558991614,2cyclictest7956-21kworker/4:2+events23:01:014
16558991614,2cyclictest7956-21kworker/4:2+events19:49:404
16552991612,3cyclictest695-21rs:main3
1654399168,6cyclictest10911-21wc22:20:251
1654399161,9cyclictest19130-21sh21:14:401
16543991613,2cyclictest29455-21turbostat23:29:551
16543991612,3cyclictest646-21systemd-logind20:50:021
1654399160,9cyclictest21479-21sh21:33:321
1653899160,7cyclictest14760-21sh22:22:510
1653899160,11cyclictest28672-21ssh23:05:550
2140499150,8tDemoTimingTask21408-21taskset19:19:075
1655899152,9cyclictest32447-21aten2_r5power_v22:15:114
1655899152,9cyclictest16521-21ssh00:29:274
1655299154,6cyclictest7614-21ntpq19:55:183
16552991511,3cyclictest12845-21kworker/3:0+events00:09:243
16552991511,3cyclictest12845-21kworker/3:0+events00:09:233
1655299151,10cyclictest32414-21sh23:44:303
1655299151,10cyclictest16272-21ssh22:05:303
1655299150,10cyclictest16486-21ssh00:29:253
1654799158,5cyclictest20107-21cut19:15:142
1654799154,8cyclictest5899-21cpuspeed21:00:122
1654799152,9cyclictest28103-21sh21:36:462
1654799151,10cyclictest17832-21/usr/sbin/munin00:30:132
1654799150,12cyclictest227-1md0_raid123:45:062
1654399154,8cyclictest716-21snmpd21:55:341
1654399153,9cyclictest24505-21cpuspeed_turbos21:35:121
1654399153,8cyclictest12363-21forks23:15:161
1654399152,9cyclictest6349-21ssh21:42:511
1654399151,8cyclictest1358-21ssh00:38:561
16543991513,2cyclictest12843-21kworker/1:1+events00:17:461
16543991511,3cyclictest1-21systemd22:00:201
1654399151,10cyclictest5459-21latency_hist21:25:011
1654399151,10cyclictest21639-21ssh21:50:401
1654399151,10cyclictest14154-21rm22:05:091
1654399150,9cyclictest3584-21ssh23:45:411
1654399150,9cyclictest22421-21ssh23:38:501
1653899156,7cyclictest780-21runrttasks19:59:160
1653899156,7cyclictest31556-21ssh23:43:540
1653899156,7cyclictest30720-21sh22:50:000
1653899156,7cyclictest29884-21sh00:36:110
1653899155,8cyclictest780-21runrttasks20:33:570
1653899154,8cyclictest28688-21awk22:30:190
1653899154,6cyclictest21074-21cat21:50:220
1653899151,10cyclictest14704-21sh23:52:110
1653899150,9cyclictest6411-21ssh22:54:200
1653899150,8cyclictest23566-21sh23:39:360
1653899150,8cyclictest18423-21runrttasks21:14:110
1653899150,11cyclictest6387-21ssh00:23:360
730729140,3tAtEmLog_015409-21chrt23:16:315
2826699140,9tDemoTimingTask27516-21sleep20:44:555
1991429140,8tAtEmLog_013460-21sleep00:14:565
1655899142,8cyclictest20722-21swap19:15:234
1655899141,9cyclictest5038-21runrttasks20:59:104
16558991412,2cyclictest7956-21kworker/4:2+events21:51:344
1655899140,8cyclictest10146-21diskmemload22:14:214
1655899140,8cyclictest10146-21diskmemload22:14:204
1655899140,7cyclictest2410450latency_hist23:40:004
1655899140,11cyclictest6043-21grep00:23:244
1655899140,10cyclictest9726-21ssh21:45:014
1655899140,10cyclictest8876-21sh22:01:384
1655899140,10cyclictest780-21runrttasks21:03:024
1655899140,10cyclictest3901-21sh22:35:014
1655899140,10cyclictest15506-21ssh23:16:364
1655899140,10cyclictest11639-21sh22:56:404
1655299145,7cyclictest32425-21aten2_r5power_v00:20:123
1655299141,9cyclictest780-21runrttasks22:30:093
1655299141,9cyclictest716-21snmpd20:25:513
1655299141,9cyclictest23442-21sh23:20:463
1655299141,9cyclictest19910-21sh22:25:243
1655299141,9cyclictest13637-21ssh23:51:253
1655299141,12cyclictest31026-21missed_timers23:25:173
1655299141,10cyclictest21241-21runrttasks19:17:103
1655299140,10cyclictest9799-21sed20:00:173
1655299140,10cyclictest780-21runrttasks22:35:143
1655299140,10cyclictest780-21runrttasks21:20:163
1655299140,10cyclictest7193-21ssh22:00:313
1655299140,10cyclictest6582-21/usr/sbin/munin23:30:123
1655299140,10cyclictest5729-21/usr/sbin/munin21:00:183
1655299140,10cyclictest5221-21sh23:46:513
1655299140,10cyclictest32089-21chrt20:48:173
1655299140,10cyclictest31985-21ssh21:56:303
1655299140,10cyclictest31269-21/usr/sbin/munin22:50:253
1655299140,10cyclictest3060-21/usr/sbin/munin20:55:163
1655299140,10cyclictest29438-21ssh21:37:423
1655299140,10cyclictest28415-21sh23:05:453
1655299140,10cyclictest26619-21ssh00:35:033
1655299140,10cyclictest26152-21sh21:53:483
1655299140,10cyclictest25663-21grep20:35:133
1655299140,10cyclictest25057-21sh21:17:253
1655299140,10cyclictest24949-21ssh23:58:013
1655299140,10cyclictest23301-21cut22:10:123
1655299140,10cyclictest23301-21cut22:10:113
1655299140,10cyclictest22382-21rm21:34:093
1655299140,10cyclictest20790-21ssh00:31:093
1655299140,10cyclictest19780-21sed20:20:233
1655299140,10cyclictest18900-21ssh23:00:263
1655299140,10cyclictest17143-21ssh22:41:493
1655299140,10cyclictest1688-21sh00:03:053
1655299140,10cyclictest13861-21sh00:10:053
1655299140,10cyclictest13715-21sh22:58:073
1655299140,10cyclictest13039-21ssh22:21:403
1655299140,10cyclictest11001-21/usr/sbin/munin21:10:243
1654799143,9cyclictest18137-21/usr/sbin/munin19:10:172
1654799143,6cyclictest755-21postgres22:53:342
1654799142,9cyclictest18786-21ssh23:36:172
1654799141,9cyclictest731-21sshd22:48:302
1654799141,9cyclictest428-21ssh22:32:492
1654799141,9cyclictest32447-21aten2_r5power_v22:15:112
1654799141,9cyclictest30564-21sh23:43:112
1654799141,9cyclictest2437-21runrttasks20:54:462
16547991412,2cyclictest12667-21kworker/2:0+events20:47:422
1654799141,10cyclictest32622-21diskmemload23:25:542
1654799140,12cyclictest18747-21latency_hist23:54:592
1654799140,11cyclictest31248-21sh22:14:372
1654799140,11cyclictest31248-21sh22:14:362
1654799140,10cyclictest9777-21ssh21:45:042
1654799140,10cyclictest8921-21latency_hist20:00:002
1654799140,10cyclictest8771-21sh21:26:022
1654799140,10cyclictest872-21/usr/sbin/munin21:40:202
1654799140,10cyclictest7894-21ssh22:55:102
1654799140,10cyclictest514-21wc19:40:232
1654799140,10cyclictest3888-21sh21:24:002
1654799140,10cyclictest3528-21ssh00:21:372
1654799140,10cyclictest31003-21rm21:55:512
1654799140,10cyclictest26655-21runrttasks00:35:042
1654799140,10cyclictest26396-21expr23:05:142
1654799140,10cyclictest25552-21sh21:53:222
1654799140,10cyclictest25312-21ssh23:58:162
1654799140,10cyclictest23819-21taskset19:24:102
1654799140,10cyclictest23407-21sh21:16:152
1654799140,10cyclictest21228-21ssh22:26:022
1654799140,10cyclictest20740-21/usr/sbin/munin20:25:182
1654799140,10cyclictest17552-21ssh22:42:052
1654799140,10cyclictest16895-21ssh00:11:052
1654799140,10cyclictest16868-21ssh23:00:082
1654799140,10cyclictest16765-21date19:10:002
1654799140,10cyclictest16468-21sh23:17:172
1654799140,10cyclictest14139-21ssh22:22:252
1654799140,10cyclictest1276-21ssh00:02:472
1654799140,10cyclictest11451-21ssh23:32:292
1654799140,10cyclictest11121-21ssh22:03:142
1654799140,10cyclictest10343-21ssh00:25:212
1654399145,8cyclictest28203-21/usr/sbin/munin20:40:151
1654399143,8cyclictest31707-21cut19:40:121
1654399142,9cyclictest755-21postgres19:52:271
1654399141,9cyclictest24811-21gltestperf19:25:141
1654399141,9cyclictest1284-21ssh22:50:451
1654399141,9cyclictest11899-21diskmemload00:26:121
16543991411,2cyclictest12843-21kworker/1:1+events22:43:221
16543991410,3cyclictest7729-21needreboot23:30:181
16543991410,3cyclictest23611-21tr22:10:131
16543991410,3cyclictest23611-21tr22:10:131
1654399140,8cyclictest24260-21sh22:45:271
1654399140,10cyclictest9939-21ssh00:07:341
1654399140,10cyclictest9939-21ssh00:07:341
1654399140,10cyclictest8474-21ssh22:37:051
1654399140,10cyclictest7945-21ssh22:19:391
1654399140,10cyclictest780-21runrttasks21:45:401
1654399140,10cyclictest780-21runrttasks21:15:081
1654399140,10cyclictest6029-21ssh00:23:231
1654399140,10cyclictest2975-21sh22:34:341
1654399140,10cyclictest29626-21ssh23:06:361
1654399140,10cyclictest29005-21wget19:35:141
1654399140,10cyclictest25486-21apt-get20:35:121
1654399140,10cyclictest2443-21sh23:10:051
1654399140,10cyclictest23954-21ssh00:33:241
1654399140,10cyclictest21972-21ssh23:55:571
1654399140,10cyclictest18940-21runrttasks19:12:541
1654399140,10cyclictest16931-21/usr/sbin/munin23:00:241
1654399140,10cyclictest16047-21ssh23:53:071
1654399140,10cyclictest13967-21sh00:10:091
1654399140,10cyclictest12629-21sh22:57:201
1654399140,10cyclictest10144-21sh21:26:591
1653899146,6cyclictest17809-21ssh00:30:100
1653899145,7cyclictest31244-21ntpq23:25:190
1653899142,9cyclictest29706-21taskset21:55:210
1653899142,9cyclictest22561-21if_err_enp6s019:20:170
1653899142,10cyclictest19305-21diskmemload23:55:130
1653899141,9cyclictest3591-21runrttasks19:49:510
1653899141,9cyclictest20330-21runrttasks20:24:190
1653899141,7cyclictest19151-21latency_hist19:15:000
1653899140,7cyclictest7430-21ssh21:25:230
1653899140,7cyclictest32382-21cut22:15:110
1653899140,7cyclictest24693-21sh00:15:220
1653899140,12cyclictest23658-21df22:10:130
1653899140,12cyclictest23658-21df22:10:120
1653899140,12cyclictest13167-21taskset22:40:090
1653899140,11cyclictest28029-21diskmemload21:36:420
1653899140,10cyclictest8091-21/usr/sbin/munin21:05:180
1653899140,10cyclictest780-21runrttasks00:02:500
1653899140,10cyclictest744-21postgres19:35:260
1653899140,10cyclictest3126-21ssh21:23:270
1653899140,10cyclictest26101-21ssh21:18:100
1653899140,10cyclictest16767-21ssh23:00:040
1653899140,10cyclictest13466-21ssh21:46:300
1653899140,10cyclictest13081-21sh23:15:200
1653899140,10cyclictest10840-21sh22:03:020
1653899140,10cyclictest10341-21rm23:14:310
1565899140,11tDemoTimingTask17826-21chrt20:17:305
1565899140,11tDemoTimingTask17826-21chrt20:17:305
619999131,10tDemoTimingTask8465-21chrt19:58:405
382599130,11tDemoTimingTask12001-21chrt21:45:295
358299130,11tDemoTimingTask4371-21chrt22:17:085
2070199130,11tDemoTimingTask22682-21chrt20:29:225
1655899137,5cyclictest25763-21tr20:35:144
1655899134,8cyclictest777-21/usr/sbin/munin20:50:144
1655899134,8cyclictest27201-21/usr/sbin/munin23:05:194
1655899133,7cyclictest7342-21smartctl23:30:164
1655899131,9cyclictest8044-21runrttasks23:12:524
1655899131,9cyclictest29699-21ssh22:30:364
1655899130,9cyclictest8079-21chrt21:05:034
1655899130,9cyclictest780-21runrttasks23:55:064
1655899130,9cyclictest780-21runrttasks19:12:214
1655899130,9cyclictest7359-21ssh21:25:224
1655899130,9cyclictest6572-21/usr/sbin/munin19:55:124
1655899130,9cyclictest609-21runrttasks21:40:014
1655899130,9cyclictest31860-21ssh23:25:244
1655899130,9cyclictest31569-21sh00:01:174
1655899130,9cyclictest31372-21/usr/sbin/munin22:50:124
1655899130,9cyclictest30262-21rm00:18:574
1655899130,9cyclictest29301-21/usr/sbin/munin19:35:154
1655899130,9cyclictest29174-21/usr/sbin/munin21:20:184
1655899130,9cyclictest27823-21/usr/sbin/munin20:40:164
1655899130,9cyclictest25987-21runrttasks19:26:434
1655899130,9cyclictest24193-21/usr/sbin/munin21:35:254
1655899130,9cyclictest21831-21/usr/sbin/munin19:20:134
1655899130,9cyclictest20027-21ssh21:15:064
1655899130,9cyclictest19637-21sensors_volt20:20:194
1655899130,9cyclictest19493-21cut22:25:184
1655899130,9cyclictest17486-21sh22:06:224
1655899130,9cyclictest17301-21chrt21:30:384
1655899130,9cyclictest15920-21runrttasks22:40:584
1655899130,9cyclictest13984-21/usr/sbin/munin00:10:184
1655899130,9cyclictest13723-21ssh21:10:554
1655899130,9cyclictest12561-21sh23:50:394
1655899130,9cyclictest11971-21ssh22:20:554
1655899130,10cyclictest9597-21sed20:00:154
1655899130,10cyclictest780-21runrttasks23:40:104
1655899130,10cyclictest6780-21grep00:05:294
1655899130,10cyclictest6780-21grep00:05:284
1655899130,10cyclictest5912-21runrttasks19:51:014
1655899130,10cyclictest560-21rm21:57:144
1655899130,10cyclictest3757-21ssh23:45:494
1655899130,10cyclictest28605-21ssh00:35:234
1655899130,10cyclictest24255-21sh22:45:264
1655899130,10cyclictest24058-21ssh23:21:124
1655899130,10cyclictest15064-21sed20:10:244
1655299134,7cyclictest27883-21aten2_r5power_e20:40:133
1655299131,7cyclictest23243-21runrttasks00:15:113
1655299130,9cyclictest9947-21/usr/sbin/munin21:45:133
1655299130,9cyclictest716-21snmpd19:20:493
1655299130,9cyclictest5997-21runrttasks19:52:083
1655299130,9cyclictest362-21/usr/sbin/munin20:50:193
1655299130,9cyclictest3243-21sh23:10:143
1655299130,9cyclictest3218-21sh21:40:413
1655299130,9cyclictest31616-21/usr/sbin/munin19:40:233
1655299130,9cyclictest28944-21/usr/sbin/munin19:35:143
1655299130,9cyclictest26966-21fschecks_count19:30:153
1655299130,9cyclictest25379-21sh22:46:143
1655299130,9cyclictest2091-21sh22:15:333
1655299130,9cyclictest17572-21tail20:15:233
1655299130,9cyclictest17572-21tail20:15:223
1655299130,9cyclictest16978-21rm19:10:003
1655299130,9cyclictest16611-21sed19:09:593
1655299130,9cyclictest15506-21sh23:35:073
1655299130,9cyclictest14264-21grep20:10:153
1655299130,10cyclictest8686-21grep21:05:153
1655299130,10cyclictest25244-21netstat19:25:173
1654799131,9cyclictest23800-21sh00:15:162
1654799131,9cyclictest14633-21df_inode22:05:142
1654799130,9cyclictest7403-21sh00:05:452
1654799130,9cyclictest7403-21sh00:05:452
1654799130,9cyclictest6232-21taskset19:54:422
1654799130,9cyclictest3949-21latency_hist19:50:002
1654799130,9cyclictest28955-21aten2_r5power_c19:35:132
1654799130,9cyclictest28850-21latency_hist19:35:002
1654799130,9cyclictest27823-21/usr/sbin/munin20:40:262
1654799130,9cyclictest2602-21/usr/sbin/munin23:10:182
1654799130,9cyclictest25803-21cpuspeed_turbos20:35:142
1654799130,9cyclictest24128-21needreboot20:30:182
1654799130,9cyclictest18388-21/usr/sbin/munin20:20:232
1654799130,9cyclictest17545-21taskset21:30:482
1654799130,9cyclictest13352-21latency_hist20:10:012
1654799130,10cyclictest4329-21cpuspeed22:35:132
1654799130,10cyclictest16695-21basename20:15:132
1654799130,10cyclictest16695-21basename20:15:132
1654799130,10cyclictest11860-21cat21:10:162
1654399139,3cyclictest5947-21cpuspeed_turbos21:00:131
1654399131,9cyclictest31195-21ssh00:01:011
1654399130,9cyclictest6565-21/usr/sbin/munin19:55:231
1654399130,9cyclictest3729-21hddtemp_smartct20:55:151
1654399130,9cyclictest30495-21cpuspeed_turbos20:45:121
1654399130,9cyclictest2561-21head19:45:171
1654399130,9cyclictest24483-21ssh23:40:031
1654399130,9cyclictest23092-21/usr/sbin/munin20:30:141
1654399130,9cyclictest23032-21mailstats19:20:201
1654399130,9cyclictest21147-21taskset19:15:561
1654399130,9cyclictest13656-21apt-get20:10:111
1654399130,9cyclictest11297-21/usr/sbin/munin20:05:141
1654399130,10cyclictest716-21snmpd20:15:241
1654399130,10cyclictest716-21snmpd20:15:231
1654399130,10cyclictest27267-21idleruntime19:30:161
1654399130,10cyclictest18928-21cut20:20:141
1654399130,10cyclictest10002-21runrttasks21:08:151
1653899133,7cyclictest174-1kworker/0:1H+kblockd19:29:160
1653899131,9cyclictest780-21runrttasks19:53:370
1653899131,9cyclictest349-21taskset20:50:030
1653899131,9cyclictest19741-21cpuspeed_turbos19:15:120
1653899130,9cyclictest780-21runrttasks20:01:340
1653899130,9cyclictest780-21runrttasks19:30:140
1653899130,9cyclictest30518-21cstates20:45:120
1653899130,9cyclictest28607-21runintdemo5min20:40:160
1653899130,9cyclictest1164-21diskmemload23:45:070
1653899130,7cyclictest174-1kworker/0:1H+kblockd21:00:030
1653899130,7cyclictest174-1kworker/0:1H+kblockd00:10:220
1653899130,6cyclictest780-21runrttasks20:36:530
1653899130,10cyclictest32666-21ntpq19:40:180
1653899130,10cyclictest21543-21sed20:25:170
1653899130,10cyclictest174-1kworker/0:1H+kblockd20:16:520
1653899130,10cyclictest174-1kworker/0:1H+kblockd20:16:510
1653899130,10cyclictest14318-21hddtemp_smartct20:10:150
1401799130,11tDemoTimingTask16159-21taskset19:06:215
1335629130,2tAtEmLog_015999-21chrt21:12:315
741799120,10tDemoTimingTask7571-21chrt21:02:165
2935099120,10tDemoTimingTask2983-21chrt00:21:145
2682699120,10tDemoTimingTask30533-21chrt22:14:085
2682699120,10tDemoTimingTask30533-21chrt22:14:075
2140329120,10tAtEmLog_023724-21taskset19:22:555
1904599120,10tDemoTimingTask19090-21chrt19:14:175
1655899124,6cyclictest30517-21ls20:45:124
1655899124,6cyclictest11829-21fschecks_time20:05:134
1655899120,9cyclictest31494-21gpgv19:40:014
1655899120,9cyclictest23092-21/usr/sbin/munin20:30:184
1655899120,9cyclictest20787-21aten2_r5power_e20:25:114
1655899120,9cyclictest17936-21runrttasks20:19:034
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional