You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 13:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Fri Apr 24, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
398682525141,7sleep40-21swapper/407:06:554
3987301994341,2cyclictest515250-21kworker/u16:1+events_unbound12:28:595
4926342410,0sleep7492635-21sh12:18:387
3987301994139,2cyclictest199343-21kworker/u16:4+events_unbound10:39:525
3987301994037,2cyclictest125090-21kworker/u16:2+events_unbound10:04:245
3987301993937,2cyclictest282465-21kworker/u16:3+events_unbound12:04:555
39867182393,31sleep70-21swapper/707:05:227
3987301993836,2cyclictest396485-21kworker/u16:1+events_unbound11:42:285
3987301993836,2cyclictest368311-21kworker/u16:2+events_unbound12:00:395
3987301993836,2cyclictest368311-21kworker/u16:2+events_unbound11:32:075
3987301993834,3cyclictest4039351-21kworker/u16:2+events_unbound08:04:365
3987301993734,2cyclictest138207-21kworker/u16:1+flush-8:010:19:375
3987301993634,2cyclictest8211-21kworker/u16:2+flush-8:009:19:215
3987301993634,2cyclictest517588-21kworker/u16:4+events_unbound12:35:405
3987301993634,2cyclictest4143793-21kworker/u16:1+events_unbound09:38:485
3987301993634,2cyclictest396485-21kworker/u16:1+events_unbound11:57:125
3987301993634,2cyclictest396485-21kworker/u16:1+events_unbound11:57:125
3987301993634,2cyclictest282465-21kworker/u16:3+events_unbound11:28:075
3987301993634,2cyclictest282465-21kworker/u16:3+events_unbound11:00:595
3987301993634,2cyclictest233584-21kworker/u16:1+events_unbound10:34:455
3987301993634,2cyclictest125090-21kworker/u16:2+events_unbound10:04:165
3987301993533,2cyclictest428846-21kworker/u16:0+events_unbound12:21:085
3987301993533,2cyclictest368311-21kworker/u16:2+events_unbound11:52:075
3987301993533,2cyclictest368311-21kworker/u16:2+events_unbound11:52:075
3987301993533,2cyclictest282465-21kworker/u16:3+events_unbound12:33:485
3987301993533,2cyclictest282465-21kworker/u16:3+events_unbound12:33:485
3987301993533,2cyclictest282465-21kworker/u16:3+events_unbound11:48:285
3987301993533,2cyclictest282465-21kworker/u16:3+events_unbound11:37:165
3987301993533,2cyclictest233584-21kworker/u16:1+events_unbound10:56:565
398442723523,7sleep50-21swapper/507:04:475
3987301993432,2cyclictest342895-21kworker/u16:1+events_unbound11:20:435
3987301993432,2cyclictest295651-21kworker/u16:2+events_unbound11:18:445
3987301993432,2cyclictest282465-21kworker/u16:3+events_unbound12:17:295
3987301993432,2cyclictest17831-21kworker/u16:0+events_unbound09:46:515
3987301993432,2cyclictest17831-21kworker/u16:0+events_unbound09:46:515
3987301993432,2cyclictest171916-21kworker/u16:0+events_unbound10:33:045
3987306993328,4cyclictest150165-21latency_hist09:59:217
3987301993331,2cyclictest368311-21kworker/u16:2+events_unbound12:14:085
3987301993331,2cyclictest282465-21kworker/u16:3+flush-8:011:04:525
3987301993331,2cyclictest27823-21kworker/u16:4+events_unbound09:33:165
3987301993230,2cyclictest27823-21kworker/u16:4+events_unbound09:57:125
3987301993230,2cyclictest233584-21kworker/u16:1+events_unbound10:47:575
3987301993230,2cyclictest138207-21kworker/u16:1+flush-8:010:14:565
3987301993129,2cyclictest4143793-21kworker/u16:1+events_unbound09:28:365
3987301993129,2cyclictest17831-21kworker/u16:0+events_unbound09:50:535
3987301993129,2cyclictest171916-21kworker/u16:0+events_unbound10:51:085
3987301993129,2cyclictest150401-21kworker/u16:3+events_unbound10:12:275
3987299993129,2cyclictest282465-21kworker/u16:3+flush-8:010:58:434
4808302300,1chrt480826-21latency_hist12:14:217
3987301993028,2cyclictest4143793-21kworker/u16:1+events_unbound09:23:375
3987301993028,2cyclictest282465-21kworker/u16:3+flush-8:011:10:275
3987301993028,2cyclictest27823-21kworker/u16:4+events_unbound09:11:365
3987301993028,2cyclictest17831-21kworker/u16:0+events_unbound09:40:285
3987301993028,2cyclictest171916-21kworker/u16:0+events_unbound10:25:365
3987299993028,2cyclictest515250-21kworker/u16:1+flush-8:012:29:214
4306492290,1sleep40-21swapper/411:52:144
4306492290,1sleep40-21swapper/411:52:144
398730699280,26cyclictest52174-21latency_hist09:19:227
3987301992826,2cyclictest4039351-21kworker/u16:2+events_unbound08:04:015
3987301992725,2cyclictest4143793-21kworker/u16:1+events_unbound08:38:015
3987301992624,2cyclictest4039351-21kworker/u16:2+events_unbound08:33:455
3987301992624,2cyclictest3987054-21kworker/u16:4+events_unbound07:40:325
3987301992523,2cyclictest4039351-21kworker/u16:2+events_unbound08:14:015
3987306992418,5cyclictest4058145-21latency_hist07:44:227
3987305992422,2cyclictest4143793-21kworker/u16:1+events_unbound09:24:366
3987306992318,4cyclictest635-21systemd-journal11:49:207
3987305992321,2cyclictest4087296-21kworker/u16:0+flush-8:008:09:366
3987301992321,2cyclictest4000933-21kworker/u16:1+events_unbound07:28:005
3987299992320,2cyclictest4077327-21kworker/u16:3+events_unbound08:14:364
398671722313,7sleep60-21swapper/607:05:216
3987306992217,4cyclictest297230-21latency_hist10:59:227
3987299992218,3cyclictest4039351-21kworker/u16:2+flush-8:007:39:404
3987301992119,2cyclictest4077327-21kworker/u16:3+events_unbound08:25:315
3987301992119,2cyclictest4039351-21kworker/u16:2+events_unbound07:49:005
3987301992119,2cyclictest3968334-21kworker/u16:0+flush-8:007:19:325
3987299992119,2cyclictest4029557-21kworker/u16:0+events_unbound07:34:214
3987306992014,5cyclictest4077321-21latency_hist07:54:227
3987301992016,3cyclictest4001453-21diskstats07:14:355
3987301991917,2cyclictest4077327-21kworker/u16:3+events_unbound08:19:395
3987301991917,2cyclictest4077327-21kworker/u16:3+events_unbound08:19:395
3987301991917,2cyclictest4039351-21kworker/u16:2+events_unbound08:15:315
3987301991916,2cyclictest4077327-21kworker/u16:3+events_unbound07:54:325
3987299991916,2cyclictest4143793-21kworker/u16:1+events_unbound09:09:294
3987299991916,2cyclictest4143793-21kworker/u16:1+events_unbound08:54:364
3987305991815,3cyclictest17831-21kworker/u16:0+flush-8:009:40:256
3987301991816,2cyclictest4039351-21kworker/u16:2+events_unbound07:49:475
3987301991816,2cyclictest17831-21kworker/u16:0+events_unbound09:06:315
3987299991816,2cyclictest4039351-21kworker/u16:2+flush-8:008:29:374
3987299991816,2cyclictest282465-21kworker/u16:3+events_unbound12:14:164
3987299991815,2cyclictest4077327-21kworker/u16:3+events_unbound08:24:364
398730699170,15cyclictest1234-21snmpd08:36:527
3987301991714,2cyclictest3987054-21kworker/u16:4+events_unbound07:34:235
3987301991714,2cyclictest3987054-21kworker/u16:4+events_unbound07:34:235
3987299991715,2cyclictest4039351-21kworker/u16:2+events_unbound07:54:364
3987299991715,2cyclictest233584-21kworker/u16:1+flush-8:010:29:594
398730699160,14cyclictest0-21swapper/708:39:457
3987301991614,2cyclictest8211-21kworker/u16:2+flush-8:008:59:425
3987299991614,2cyclictest199343-21kworker/u16:4+flush-8:010:34:394
3987299991613,2cyclictest282465-21kworker/u16:3+flush-8:011:09:274
3987306991510,4cyclictest407387-21basename11:44:207
3987301991513,2cyclictest4143793-21kworker/u16:1+flush-8:008:48:005
3987301991513,2cyclictest4143793-21kworker/u16:1+events_unbound08:59:025
3987301991513,2cyclictest4077327-21kworker/u16:3+events_unbound08:52:315
398729999150,1cyclictest0-21swapper/410:06:544
398730699145,7cyclictest6382-21gvfs-afc-volume07:59:497
3987306991412,1cyclictest0-21swapper/711:29:447
3987306991412,1cyclictest0-21swapper/710:44:487
3987306991412,1cyclictest0-21swapper/707:29:447
3987306991411,2cyclictest0-21swapper/709:34:227
398730699140,1cyclictest0-21swapper/709:24:447
398730699140,1cyclictest0-21swapper/707:54:447
398730699140,13cyclictest1234-21snmpd07:09:237
398730699140,12cyclictest635-21systemd-journal10:34:217
398730699140,12cyclictest260538-21latency_hist10:44:217
3987305991413,1cyclictest0-21swapper/609:53:436
398730599140,1cyclictest0-21swapper/608:49:436
3987301991412,2cyclictest4077327-21kworker/u16:3+flush-8:008:44:045
3987301991412,2cyclictest3987054-21kworker/u16:4+events_unbound07:31:315
3987299991413,1cyclictest27823-21kworker/u16:4+events_unbound09:26:474
3987299991412,2cyclictest4143793-21kworker/u16:1+events_unbound09:39:004
398730699139,3cyclictest1234-21snmpd12:31:117
398730699139,3cyclictest1234-21snmpd12:31:117
398730699139,3cyclictest1234-21snmpd08:09:437
398730699138,4cyclictest909-21in:imjournal11:39:217
398730699138,4cyclictest6382-21gvfs-afc-volume09:04:347
398730699138,4cyclictest212876-21cat10:24:357
3987306991310,2cyclictest0-21swapper/711:24:497
3987306991310,2cyclictest0-21swapper/708:29:397
398730699130,11cyclictest1234-21snmpd07:46:487
398730599134,1cyclictest0-21swapper/609:29:496
3987305991310,2cyclictest125090-21kworker/u16:2+flush-8:010:14:276
398730599130,13cyclictest0-21swapper/607:29:376
3987301991311,2cyclictest3968334-21kworker/u16:0+events_unbound07:09:515
3987299991311,2cyclictest4154252-21kworker/u16:0+flush-8:008:34:584
398729999130,13cyclictest0-21swapper/409:17:524
4937212120,0sleep60-21swapper/612:19:336
398730699129,2cyclictest0-21swapper/711:04:477
398730699128,3cyclictest1234-21snmpd11:57:377
398730699128,3cyclictest1234-21snmpd11:57:377
398730699128,3cyclictest1234-21snmpd11:22:247
398730699128,3cyclictest1234-21snmpd10:06:197
398730699128,3cyclictest1234-21snmpd08:48:537
398730699128,3cyclictest1234-21snmpd08:16:407
398730699127,4cyclictest6382-21gvfs-afc-volume08:49:357
398730699127,4cyclictest323028-21cat11:09:367
398730699127,4cyclictest188311-21cat10:14:357
398730699126,5cyclictest6382-21gvfs-afc-volume09:44:417
398730699126,5cyclictest6382-21gvfs-afc-volume09:44:417
398730699126,5cyclictest273969-21tune2fs10:49:357
3987306991210,1cyclictest0-21swapper/712:04:477
398730699120,11cyclictest1234-21snmpd09:44:007
398730599129,2cyclictest4087821-21diskstats07:59:346
398730599129,2cyclictest4077327-21kworker/u16:3+flush-8:008:39:486
3987305991211,1cyclictest0-21swapper/612:39:166
3987305991211,1cyclictest0-21swapper/611:04:316
3987305991211,1cyclictest0-21swapper/611:04:216
3987305991210,2cyclictest86-21ksoftirqd/610:09:466
398730599120,12cyclictest0-21swapper/607:54:036
398729999127,4cyclictest3988317-21iostat_ios07:09:364
398729999127,4cyclictest139207-21cat09:54:344
3987299991211,1cyclictest0-21swapper/408:40:594
3987299991210,2cyclictest248400-21kworker/u16:2+events_unbound10:41:324
398730699119,1cyclictest0-21swapper/711:49:497
398730699119,1cyclictest0-21swapper/711:49:497
398730699118,2cyclictest1234-21snmpd12:21:537
398730699118,2cyclictest1234-21snmpd10:10:227
398730699118,2cyclictest1234-21snmpd09:22:577
398730699118,2cyclictest1234-21snmpd07:16:147
398730699117,3cyclictest1234-21snmpd10:34:327
398730699117,3cyclictest1234-21snmpd08:55:177
398730699117,3cyclictest1234-21snmpd08:22:047
398730699117,3cyclictest1234-21snmpd08:22:047
398730699117,3cyclictest1234-21snmpd07:28:487
398730699117,3cyclictest0-21swapper/709:34:397
398730699116,5cyclictest6382-21gvfs-afc-volume10:02:347
398730699115,6cyclictest6895-21gmain11:00:357
398730699115,5cyclictest6382-21gvfs-afc-volume09:10:027
398730699115,5cyclictest5729-21ssh-agent12:24:497
398730699114,6cyclictest5975-21gmain12:01:557
398730699110,10cyclictest1234-21snmpd09:52:517
398730599119,2cyclictest86-21ksoftirqd/609:04:486
398730599118,2cyclictest4143535-21ntpq08:24:466
398730599110,4cyclictest1124-21cut08:54:376
398730599110,11cyclictest0-21swapper/607:56:356
398729999119,2cyclictest4077327-21kworker/u16:3+flush-8:008:19:364
398729999119,2cyclictest4077327-21kworker/u16:3+flush-8:008:19:364
398729999118,3cyclictest8211-21kworker/u16:2+flush-8:009:09:164
398729999118,2cyclictest4189604-21kthreadcore08:49:394
3987299991110,1cyclictest150401-21kworker/u16:3+events_unbound10:18:324
398729999110,11cyclictest0-21swapper/408:10:244
398729999110,11cyclictest0-21swapper/408:08:494
398730699107,2cyclictest1234-21snmpd08:04:317
398730699106,3cyclictest864-21NetworkManager12:37:207
398730699106,3cyclictest1234-21snmpd08:25:587
398730699106,3cyclictest1234-21snmpd07:20:027
398730699104,5cyclictest6382-21gvfs-afc-volume07:34:467
398730699104,5cyclictest6382-21gvfs-afc-volume07:34:467
398730699104,4cyclictest12084-21grep08:59:397
398730599109,1cyclictest0-21swapper/607:17:296
398730599107,2cyclictest4130695-21cut08:19:406
398730599107,2cyclictest4130695-21cut08:19:406
398730599105,4cyclictest417002-21chrt11:44:556
398730599105,4cyclictest4049747-21cat07:39:376
398730599102,7cyclictest116810-21kthreadcore09:44:386
398730599102,7cyclictest116810-21kthreadcore09:44:386
398730599102,7cyclictest0-21swapper/609:19:416
398730599100,9cyclictest0-21swapper/608:35:226
398729999108,2cyclictest4077327-21kworker/u16:3+events_unbound08:59:454
398729999108,2cyclictest368311-21kworker/u16:2+flush-8:012:29:494
398729999108,2cyclictest368311-21kworker/u16:2+flush-8:012:29:494
398729999108,2cyclictest342895-21kworker/u16:1+events_unbound11:24:374
398729999100,5cyclictest0-21swapper/411:59:054
398729999100,5cyclictest0-21swapper/411:59:054
39873069994,4cyclictest200564-21hostname10:19:367
39873069993,4cyclictest334365-21rm11:14:257
39873059997,2cyclictest86-21ksoftirqd/612:30:496
39873059997,2cyclictest86-21ksoftirqd/612:30:496
39873059997,2cyclictest86-21ksoftirqd/612:25:316
39873059997,2cyclictest86-21ksoftirqd/612:17:316
39873059997,2cyclictest86-21ksoftirqd/612:10:596
39873059997,2cyclictest86-21ksoftirqd/611:50:066
39873059997,2cyclictest86-21ksoftirqd/611:50:066
39873059997,2cyclictest86-21ksoftirqd/611:19:386
39873059997,2cyclictest86-21ksoftirqd/611:11:196
39873059997,2cyclictest86-21ksoftirqd/610:49:586
39873059997,2cyclictest86-21ksoftirqd/610:47:396
39873059997,2cyclictest86-21ksoftirqd/610:34:546
39873059997,2cyclictest86-21ksoftirqd/610:26:446
39873059997,2cyclictest86-21ksoftirqd/610:20:476
39873059991,3cyclictest40518-21cat09:14:336
39873059990,9cyclictest0-21swapper/611:54:346
39873059990,9cyclictest0-21swapper/611:54:346
39873059990,8cyclictest98053-21expr09:34:486
39873059990,8cyclictest151226-21fschecks_count09:59:346
39873059990,3cyclictest147389-21timerwakeupswit09:54:476
39873059990,2cyclictest4179638-21grep08:44:426
39873059990,2cyclictest4058536-21/usr/sbin/munin07:44:496
39873059990,2cyclictest17717-21grep08:59:496
39872999998,1cyclictest0-21swapper/407:20:344
39872999996,2cyclictest80606-21kthreadcore09:29:394
39873059986,2cyclictest86-21ksoftirqd/612:04:526
39873059986,2cyclictest86-21ksoftirqd/611:59:346
39873059986,2cyclictest86-21ksoftirqd/611:29:596
39873059986,2cyclictest86-21ksoftirqd/611:25:236
39873059986,2cyclictest86-21ksoftirqd/611:15:176
39873059986,2cyclictest86-21ksoftirqd/610:41:496
39873059986,2cyclictest86-21ksoftirqd/610:29:496
39873059986,2cyclictest86-21ksoftirqd/610:07:386
39873059986,1cyclictest0-21swapper/608:04:396
39873059986,1cyclictest0-21swapper/607:19:416
39873059984,3cyclictest3988229-21tune2fs07:09:356
39873059983,4cyclictest4121133-21cut08:14:416
39873059983,4cyclictest4020933-21cat07:24:366
39873059981,6cyclictest0-21swapper/611:39:346
39873059980,7cyclictest34500-21kthreadcore09:09:416
39873059980,1cyclictest4039359-21/usr/sbin/munin07:34:426
39873059980,1cyclictest4039359-21/usr/sbin/munin07:34:426
39872999986,2cyclictest282465-21kworker/u16:3+flush-8:011:34:434
39872999986,1cyclictest0-21swapper/409:49:394
39872999986,1cyclictest0-21swapper/409:44:374
39872999986,1cyclictest0-21swapper/409:44:374
39872999986,1cyclictest0-21swapper/409:19:394
39872999986,1cyclictest0-21swapper/407:59:414
39872999986,1cyclictest0-21swapper/407:34:344
39872999986,1cyclictest0-21swapper/407:34:344
39872999986,1cyclictest0-21swapper/407:14:274
39872999983,4cyclictest4173670-21cat08:44:344
39872999983,4cyclictest4059267-21gltestperf07:44:354
39872999983,4cyclictest109064-21cut09:39:414
39872999981,3cyclictest0-21swapper/410:45:264
39873059975,2cyclictest86-21ksoftirqd/610:55:186
39873059970,6cyclictest0-21swapper/608:29:366
39873059970,2cyclictest86-21ksoftirqd/611:35:286
39872999975,2cyclictest368311-21kworker/u16:2+flush-8:012:00:224
39872999975,2cyclictest306986-21kworker/u16:4+events_unbound11:09:014
39872999975,1cyclictest0-21swapper/409:59:394
39872999975,1cyclictest0-21swapper/407:24:384
39872999970,6cyclictest0-21swapper/407:49:374
39872999964,2cyclictest282465-21kworker/u16:3+events_unbound11:44:414
39872999964,1cyclictest0-21swapper/411:19:214
39872999963,2cyclictest4661712chrt12:05:044
39872999960,1cyclictest0-21swapper/412:34:414
39872999960,1cyclictest0-21swapper/412:15:504
39872999960,1cyclictest0-21swapper/410:50:084
39872999960,1cyclictest0-21swapper/410:10:584
39872999954,1cyclictest282465-21kworker/u16:3+events_unbound10:59:354
39872999953,2cyclictest282465-21kworker/u16:3+flush-8:012:19:314
39872999951,1cyclictest681rcuog/410:24:324
39872999950,4cyclictest395523-21taskset11:39:244
39872999950,4cyclictest354592-21taskset11:19:444
39872999950,4cyclictest199723-21taskset10:19:254
39872999950,1cyclictest681rcuog/411:29:244
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional