You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 19:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Sun Dec 14, 2025 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2801139920,0EcMasterDemoSyn2802129tAtEmLog_019:35:535
510539830,0EcMasterDemoSyn511529tAtEmLog_019:56:105
1620339830,0EcMasterDemoSyn1621329tAtEmLog_019:10:335
584539820,0EcMasterDemoSyn585529tAtEmLog_020:01:145
427439820,0EcMasterDemoSyn428429tAtEmLog_023:29:085
383239820,0EcMasterDemoSyn384229tAtEmLog_022:18:085
364239820,0EcMasterDemoSyn365429tAtEmLog_000:04:385
3230739820,0EcMasterDemoSyn3231729tAtEmLog_022:33:225
2329339820,0EcMasterDemoSyn2330329tAtEmLog_019:25:455
2254139820,0EcMasterDemoSyn2255129tAtEmLog_023:39:175
3274839810,0EcMasterDemoSyn3275829tAtEmLog_019:46:015
3212339810,0EcMasterDemoSyn3213329tAtEmLog_020:57:015
3002439810,0EcMasterDemoSyn3003629tAtEmLog_021:57:525
2267439810,0EcMasterDemoSyn2268429tAtEmLog_020:36:435
1946439810,0EcMasterDemoSyn1947429tAtEmLog_021:17:185
1946439810,0EcMasterDemoSyn1947429tAtEmLog_021:17:185
1855739810,0EcMasterDemoSyn1856729tAtEmLog_019:15:365
1839239810,0EcMasterDemoSyn1840229tAtEmLog_023:19:005
1839239810,0EcMasterDemoSyn1840229tAtEmLog_023:18:595
1748439810,0EcMasterDemoSyn1749429tAtEmLog_023:54:305
1559539810,0EcMasterDemoSyn1560529tAtEmLog_020:21:315
106952340,0sleep40-21swapper/400:26:214
310882320,0sleep20-21swapper/220:53:092
15898992523,2cyclictest30622-21kworker/1:0+events22:43:301
315402210,0sleep40-21swapper/422:33:124
1589899219,9cyclictest25204-21tail23:23:081
15898992118,2cyclictest30622-21kworker/1:0+events21:52:471
922899180,10tDemoTimingTask10668-21chrt23:14:565
3213499180,10tDemoTimingTask1985-21chrt21:00:005
2324699180,11tDemoTimingTask25032-21chrt23:05:005
15903991815,2cyclictest23927-21kworker/4:1+events21:02:034
15903991815,2cyclictest23927-21kworker/4:1+events19:30:484
15902991815,2cyclictest21658-21kworker/3:2+events21:02:033
1590299181,12cyclictest16-1pr/legacy19:15:353
1590199180,10cyclictest3863-21ssh23:11:182
1589399185,9cyclictest18643-21sh22:26:220
1589399181,13cyclictest16-1pr/legacy20:16:250
1589399180,14cyclictest8746-21sh00:07:500
1589399180,10cyclictest3218-21sh22:35:240
832139170,0EcMasterDemoSyn0-21swapper/522:38:265
3241499170,10tDemoTimingTask32531-21chrt23:08:555
1590199174,9cyclictest7715-21expr21:28:072
1589899174,9cyclictest24870-21grep19:28:181
1589399170,9cyclictest831-21runrttasks23:15:530
1589399170,9cyclictest831-21runrttasks23:15:530
1589399170,9cyclictest831-21runrttasks23:14:110
1589399170,9cyclictest831-21runrttasks00:10:110
1589399170,9cyclictest24368-21sh23:04:330
1589399170,9cyclictest16696-21diskmemload23:53:560
1589399170,9cyclictest10584-21sh21:47:130
1589399170,14cyclictest31319-21memory21:58:090
1589399170,14cyclictest20748-21sh23:20:250
3169229160,10tAtEmLog_032542-21taskset23:44:565
1590299160,12cyclictest26224-21diskstats21:38:113
1589899169,6cyclictest29163-21grep00:18:161
1589899165,8cyclictest327-21systemd-journal20:27:051
1589899160,9cyclictest12516-21sh21:30:291
1589399164,10cyclictest23040-21sh21:53:180
1589399163,9cyclictest22132-21sh23:38:590
1589399160,9cyclictest20638-21sh22:09:510
1589399160,13cyclictest3564-21runrttasks21:25:450
1589399160,13cyclictest2361-21sh00:21:590
1589399160,13cyclictest1924-21sh21:24:520
3143029150,6tAtEmLog_01746-21chrt00:21:335
2506429150,9tAtEmLog_025096-21taskset20:41:525
1590399152,9cyclictest5247-21sh21:26:544
1590399150,9cyclictest3751-21sh00:04:414
1590399150,12cyclictest32753-21latency_hist23:45:014
1590399150,11cyclictest27128-21sh23:59:434
1590299155,8cyclictest766-21/usr/sbin/munin20:58:093
1590299153,8cyclictest29186-21load23:43:073
1590299152,9cyclictest11229-21/usr/sbin/munin21:13:113
1590299151,10cyclictest14457-21/usr/sbin/munin20:18:103
1590299150,11cyclictest12951-21latency_hist20:14:593
1590299150,11cyclictest12174-21ssh23:33:203
1590199155,8cyclictest19702-21/usr/sbin/munin23:38:082
1590199155,7cyclictest13971-21kworker/u24:4+nfsiod23:02:192
1590199151,10cyclictest831-21runrttasks23:19:572
1590199151,10cyclictest831-21runrttasks23:19:562
1590199151,10cyclictest11468-21turbostat.cron22:44:552
1590199150,7cyclictest1800-21chrt00:39:152
1589899154,8cyclictest760-21lldpd22:34:261
1589899153,8cyclictest1675-21open_inodes19:48:131
1589899152,9cyclictest24985-21ssh22:12:401
15898991511,3cyclictest26316-21sh00:34:591
15898991511,3cyclictest1734-21turbostat.cron23:10:001
1589899151,10cyclictest30758-21/usr/sbin/munin21:58:041
1589899151,10cyclictest10869-21sh00:26:291
1589399156,7cyclictest13163-21ssh21:30:560
1589399153,9cyclictest25536-21sh23:58:380
15893991512,2cyclictest2370-21sh19:50:010
1589399150,6cyclictest12970-21sed21:13:160
2597429140,3tAtEmLog_027537-21chrt22:13:165
1590399143,6cyclictest7209-21aten2_r5power_c22:03:024
1590399142,9cyclictest17362-21sh21:50:314
1590399142,9cyclictest14285-21ssh21:31:404
1590399142,9cyclictest1395-21ssh21:59:184
1590399141,9cyclictest9006-21switchtime22:38:324
1590399141,9cyclictest11370-21ssh22:22:424
1590399141,10cyclictest14247-21rm21:13:594
15903991410,3cyclictest9276-21cpuspeed_turbos00:08:044
1590399140,9cyclictest28643-21ssh22:49:024
1590399140,12cyclictest27443-21ssh23:24:014
1590399140,11cyclictest807-21postgres19:53:324
1590399140,10cyclictest9800-21sh22:56:554
1590399140,10cyclictest8112-21runrttasks20:05:144
1590399140,10cyclictest7978-21latency_hist20:05:004
1590399140,10cyclictest4918-21ssh23:29:344
1590399140,10cyclictest3468-21sh00:22:484
1590399140,10cyclictest24923-21diskmemload22:12:364
1590399140,10cyclictest23481-21sh00:15:214
1590399140,10cyclictest22392-21latency_hist00:15:004
1590399140,10cyclictest19619-21sh22:27:024
1590399140,10cyclictest17583-21rm21:16:034
1590399140,10cyclictest17583-21rm21:16:024
1590399140,10cyclictest17089-21ssh23:00:384
1590399140,10cyclictest15467-21rm22:42:344
1590399140,10cyclictest1509-21diskmemload22:52:294
1590399140,10cyclictest13373-21/usr/sbin/munin20:18:044
1590399140,10cyclictest1107-21ssh00:38:444
1590299146,6cyclictest2344-21cron22:35:003
1590299142,5cyclictest18497-21tune2fs00:13:063
1590299141,9cyclictest8626-21sh00:07:453
1590299141,9cyclictest831-21runrttasks23:37:033
1590299141,9cyclictest5924-21taskset20:01:493
1590299141,9cyclictest3216-21ssh22:53:103
1590299141,9cyclictest29698-21sh23:25:223
1590299141,9cyclictest28225-21rm00:00:133
1590299141,9cyclictest23336-21taskset19:25:483
1590299141,9cyclictest20560-21/usr/sbin/munin23:03:053
1590299141,9cyclictest19341-21diskmemload23:55:223
1590299141,9cyclictest17654-21diskmemload21:16:053
1590299141,9cyclictest17654-21diskmemload21:16:043
1590299141,9cyclictest17229-21ssh21:50:253
1590299141,11cyclictest16-1pr/legacy22:23:123
1590299141,10cyclictest28040-21sh23:24:243
1590299141,10cyclictest16-1pr/legacy19:20:403
1590299140,9cyclictest28574-21/usr/sbin/munin20:48:093
1590299140,11cyclictest25620-21rm21:20:083
1590299140,10cyclictest932-21chrt23:45:183
1590299140,10cyclictest831-21runrttasks22:46:073
1590299140,10cyclictest831-21runrttasks22:27:063
1590299140,10cyclictest744-21snmpd21:05:103
1590299140,10cyclictest744-21snmpd21:05:103
1590299140,10cyclictest5670-21ssh21:27:113
1590299140,10cyclictest3347-21runrttasks23:10:563
1590299140,10cyclictest32422-21ssh00:20:173
1590299140,10cyclictest32243-21sh23:08:443
1590299140,10cyclictest3202-21sh22:35:243
1590299140,10cyclictest31308-21cat19:43:063
1590299140,10cyclictest30571-21ssh21:40:033
1590299140,10cyclictest29885-21/usr/sbin/munin20:53:083
1590299140,10cyclictest29755-21ssh00:18:393
1590299140,10cyclictest28423-21sh00:36:143
1590299140,10cyclictest25943-21ssh21:55:033
1590299140,10cyclictest22582-21chrt20:35:363
1590299140,10cyclictest17655-21ssh22:43:143
1590299140,10cyclictest17544-21latency_hist20:25:003
1590299140,10cyclictest16271-21runrttasks19:10:573
1590299140,10cyclictest15142-21rm22:59:293
1590299140,10cyclictest12156-21rm21:30:143
1590299140,10cyclictest10884-21ssh00:26:293
1590299140,10cyclictest10214-21rm21:46:583
1590199146,6cyclictest327-21systemd-journal21:10:052
1590199146,6cyclictest32123-21grep19:43:142
1590199141,9cyclictest4741-21sh22:01:232
1590199141,9cyclictest32357-21ssh22:51:252
1590199141,9cyclictest27329-21taskset20:45:552
1590199141,9cyclictest23042-21sh00:15:022
1590199141,9cyclictest17234-21ssh21:50:252
1590199141,9cyclictest10797-21runrttasks20:10:412
1590199141,8cyclictest21121-21ssh23:56:392
1590199140,8cyclictest13384-21unixbench-2d22:58:222
1590199140,11cyclictest26501-21chrt23:05:512
1590199140,10cyclictest9944-21grep20:08:102
1590199140,10cyclictest9792-21sh23:50:102
1590199140,10cyclictest8880-21rm23:32:102
1590199140,10cyclictest5436-21ssh00:05:272
1590199140,10cyclictest536-21sh00:20:432
1590199140,10cyclictest4372-21cat21:43:152
1590199140,10cyclictest31483-21ssh22:15:352
1590199140,10cyclictest31191-21sh00:02:202
1590199140,10cyclictest30473-21fschecks_count21:23:072
1590199140,10cyclictest29491-21sh22:32:332
1590199140,10cyclictest29477-21ssh23:25:122
1590199140,10cyclictest29433-21sh21:57:272
1590199140,10cyclictest28680-21ssh22:14:022
1590199140,10cyclictest28384-21/usr/sbin/munin23:43:042
1590199140,10cyclictest2755-21sh23:46:332
1590199140,10cyclictest2718-21tune2fs21:03:052
1590199140,10cyclictest2706-21chrt19:50:392
1590199140,10cyclictest24297-21sh22:47:102
1590199140,10cyclictest22559-21taskset20:35:172
1590199140,10cyclictest21838-21ssh23:21:122
1590199140,10cyclictest21501-21runrttasks21:35:152
1590199140,10cyclictest20680-21rm22:27:482
1590199140,10cyclictest18688-21sh21:16:472
1590199140,10cyclictest18688-21sh21:16:462
1590199140,10cyclictest18536-21chrt19:15:272
1590199140,10cyclictest16412-21ssh00:11:552
1590199140,10cyclictest16202-21date19:10:312
1590199140,10cyclictest16115-21ssh22:07:532
1590199140,10cyclictest14044-21hddtemp_smartct20:18:072
1590199140,10cyclictest11249-21ssh21:47:412
1590199140,10cyclictest11173-21sh22:22:342
1590199140,10cyclictest10055-21ssh00:25:532
1589899147,6cyclictest15144-21find23:53:091
1589899142,8cyclictest32636-21latency_hist19:45:001
1589899141,9cyclictest789-21postgres23:45:401
1589899141,9cyclictest5343-21runrttasks19:58:531
1589899141,9cyclictest30901-21/usr/sbin/munin20:53:071
1589899141,9cyclictest27211-21ssh22:48:151
1589899141,9cyclictest26926-21runrttasks20:44:281
1589899141,9cyclictest15542-21runrttasks20:20:571
1589899141,10cyclictest9827-21sh22:38:501
1589899141,10cyclictest16-1pr/legacy22:53:381
1589899140,10cyclictest9357-21ssh22:21:171
1589899140,10cyclictest9334-21ssh23:32:291
1589899140,10cyclictest8848-21sh00:07:551
1589899140,10cyclictest8269-21ssh22:55:511
1589899140,10cyclictest7711-21runrttasks20:03:511
1589899140,10cyclictest5050-21sh22:01:361
1589899140,10cyclictest32738-21ssh00:20:321
1589899140,10cyclictest31163-21ssh22:15:221
1589899140,10cyclictest29075-21ssh00:36:431
1589899140,10cyclictest2662-21ssh23:28:151
1589899140,10cyclictest22830-21sh21:36:091
1589899140,10cyclictest22155-21runrttasks20:33:501
1589899140,10cyclictest21594-21wc21:18:081
1589899140,10cyclictest21594-21wc21:18:071
1589899140,10cyclictest21374-21sh23:56:491
1589899140,10cyclictest17685-21ssh22:25:431
1589899140,10cyclictest16335-21chrt19:11:491
1589899140,10cyclictest15969-21ssh23:35:471
1589899140,10cyclictest14010-21sh23:17:051
1589899140,10cyclictest14010-21sh23:17:041
1589899140,10cyclictest12799-21sh22:05:361
1589899140,10cyclictest11857-21/usr/sbin/munin21:48:101
1589399148,5cyclictest27762-21grep20:48:040
1589399146,6cyclictest30549-21cpuspeed_turbos22:33:060
1589399145,7cyclictest8944-21ssh00:25:050
1589399143,8cyclictest23564-21aten2_r5power_e19:28:070
1589399141,9cyclictest29822-21runrttasks20:52:090
1589399141,9cyclictest23519-21sh00:15:230
1589399141,10cyclictest831-21runrttasks00:37:590
1589399141,10cyclictest6185-21sh23:30:150
1589399141,10cyclictest16-1pr/legacy20:01:130
1589399140,9cyclictest10105-21ssh22:57:080
1589399140,7cyclictest4825-21ssh23:48:020
1589399140,7cyclictest28193-21sh23:07:030
1589399140,7cyclictest18228-21sh00:30:200
1589399140,12cyclictest24419-21ssh22:47:140
1589399140,12cyclictest1215-21sensors00:03:110
1589399140,11cyclictest2129-21runrttasks21:01:590
1589399140,10cyclictest831-21runrttasks19:59:050
1589399140,10cyclictest3316-21ssh22:00:250
1589399140,10cyclictest327-21systemd-journal20:28:050
1589399140,10cyclictest3245-21rm22:53:110
1589399140,10cyclictest31487-21sh22:15:350
1589399140,10cyclictest29866-21sh23:25:300
1589399140,10cyclictest2804-21chrt19:51:190
1589399140,10cyclictest22470-21sh21:35:540
1589399140,10cyclictest16974-21sh21:15:380
1589399140,10cyclictest16974-21sh21:15:380
1589399140,10cyclictest15383-21rm22:42:310
1589399140,10cyclictest14202-21ssh22:23:280
365599130,10tDemoTimingTask8966-21taskset00:08:005
3003799133,7tDemoTimingTask3924-21chrt22:00:495
1590399135,6cyclictest744-21snmpd23:31:224
1590399131,9cyclictest31050-21diskmemload21:40:234
1590399131,9cyclictest27513-21sh23:06:334
1590399131,9cyclictest11682-21runrttasks21:47:554
1590399130,9cyclictest831-21runrttasks20:51:254
1590399130,9cyclictest831-21runrttasks20:33:184
1590399130,9cyclictest711-21sh23:45:104
1590399130,9cyclictest4400-21taskset21:05:554
1590399130,9cyclictest4400-21taskset21:05:554
1590399130,9cyclictest369-21taskset19:46:404
1590399130,9cyclictest3489-21ssh23:11:034
1590399130,9cyclictest27303-21taskset20:45:324
1590399130,9cyclictest24268-21kernelversion19:28:114
1590399130,9cyclictest19863-21/usr/sbin/munin19:18:104
1590399130,9cyclictest18854-21ssh00:30:484
1590399130,9cyclictest17852-21runrttasks23:37:074
1590399130,9cyclictest17405-21sh23:18:194
1590399130,9cyclictest17405-21sh23:18:184
1590399130,9cyclictest17193-21timerwakeupswit20:23:154
1590399130,9cyclictest13042-21latency_hist20:14:594
1590399130,9cyclictest12016-21ssh22:05:034
1590399130,9cyclictest10509-21ssh23:50:414
1590399130,10cyclictest831-21runrttasks19:41:014
1590399130,10cyclictest31844-21grep21:23:154
1590399130,10cyclictest30769-21ssh22:15:054
1590399130,10cyclictest28104-21runrttasks19:36:384
1590399130,10cyclictest25092-21runintdemo5min20:41:524
1590399130,10cyclictest21982-21latency19:23:084
1590399130,10cyclictest21969-21ssh21:35:344
1590399130,10cyclictest16303-21runrttasks19:11:244
1590299131,9cyclictest22110-21diskmemload22:10:393
1590299131,9cyclictest18636-21sh00:30:383
1590299130,9cyclictest831-21runrttasks20:42:363
1590299130,9cyclictest831-21runrttasks20:30:073
1590299130,9cyclictest831-21runrttasks20:06:473
1590299130,9cyclictest831-21runrttasks19:50:063
1590299130,9cyclictest475-21/usr/sbin/munin19:48:063
1590299130,9cyclictest32313-21runrttasks22:16:093
1590299130,9cyclictest27965-21runrttasks19:35:243
1590299130,9cyclictest27605-21chrt19:34:313
1590299130,9cyclictest17937-21runrttasks20:26:263
1590299130,9cyclictest13952-21ssh22:06:243
1590299130,7cyclictest11155-21ssh23:15:033
1590299130,7cyclictest11155-21ssh23:15:033
1590299130,10cyclictest9750-21ssh23:50:083
1590299130,10cyclictest2870-21ssh22:00:063
1590299130,10cyclictest15970-21cat19:10:003
1590199131,7cyclictest24231-21cat19:28:112
1590199130,9cyclictest831-21runrttasks19:23:052
1590199130,9cyclictest5773-21runrttasks20:00:242
1590199130,9cyclictest5104-21runintdemo5min19:56:102
1590199130,9cyclictest4606-21/usr/sbin/munin21:08:042
1590199130,9cyclictest4606-21/usr/sbin/munin21:08:032
1590199130,9cyclictest32245-21runrttasks20:58:032
1590199130,9cyclictest28301-21/usr/sbin/munin19:38:032
1590199130,9cyclictest27145-21latency_hist20:45:012
1590199130,9cyclictest25624-21runrttasks19:30:332
1590199130,9cyclictest2157-21unixbench_multi19:48:182
1590199130,9cyclictest15475-21taskset20:20:012
1590199130,9cyclictest12605-21ssh21:30:322
1590199130,10cyclictest3443-21sh22:35:342
1590199130,10cyclictest18238-21rm00:30:212
1590199130,10cyclictest18111-21apt-get20:28:042
1589899135,6cyclictest327-21systemd-journal20:06:181
1589899131,7cyclictest13104-21runrttasks20:15:051
1589899130,9cyclictest831-21runrttasks20:36:271
1589899130,9cyclictest831-21runrttasks19:52:481
1589899130,9cyclictest831-21runrttasks19:16:561
1589899130,9cyclictest807-21postgres19:35:301
1589899130,9cyclictest4362-21runrttasks21:05:231
1589899130,9cyclictest4362-21runrttasks21:05:221
1589899130,9cyclictest28869-21sh00:00:411
1589899130,9cyclictest27273-21runrttasks20:45:071
1589899130,9cyclictest26562-21ssh23:41:541
1589899130,9cyclictest25858-21/usr/sbin/munin19:33:111
1589899130,9cyclictest25489-21ssh21:20:021
1589899130,9cyclictest2258-21/usr/sbin/munin21:03:031
1589899130,9cyclictest21112-21runrttasks19:22:311
1589899130,9cyclictest1677-21latency_hist21:00:001
1589899130,9cyclictest11929-21missed_timers20:13:061
1589899130,10cyclictest6912-21sh21:10:101
1589899130,10cyclictest4966-21rm21:26:421
1589899130,10cyclictest32646-21ssh21:41:271
1589899130,10cyclictest2219-21sh23:10:091
1589899130,10cyclictest17252-21ssh23:00:441
1589899130,10cyclictest14575-21sh00:10:371
1589399131,9cyclictest28088-21runrttasks19:36:240
1589399131,9cyclictest16342-21runrttasks19:11:550
1589399130,9cyclictest744-21snmpd20:20:290
1589399130,9cyclictest30417-21runintdemo5min19:40:590
1589399130,9cyclictest25028-21runrttasks20:41:340
1589399130,9cyclictest22123-21runrttasks20:33:230
1589399130,9cyclictest21564-21ssh22:10:170
1589399130,9cyclictest21188-21aten2_r5power_e19:23:030
1589399130,9cyclictest15851-21latency_hist19:10:000
1589399130,7cyclictest175-1kworker/0:1H+kblockd20:05:020
1589399130,11cyclictest32550-21grep20:58:030
1589399130,11cyclictest24698-21ssh23:40:340
1589399130,10cyclictest831-21runrttasks21:06:210
1589399130,10cyclictest831-21runrttasks21:06:200
1589399130,10cyclictest831-21runrttasks20:10:280
1589399130,10cyclictest30529-21sh21:40:010
1589399130,10cyclictest25587-21chrt19:30:040
1589399130,10cyclictest19139-21df19:18:040
1589399130,10cyclictest175-1kworker/0:1H+kblockd20:36:440
1087099130,11tDemoTimingTask13146-21chrt20:15:415
1087099130,11tDemoTimingTask12716-21chrt20:13:515
820039120,0EcMasterDemoSyn0-21swapper/520:06:195
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional