You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 17:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon Dec 01, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
470982993228,1cyclictest0-21swapper/309:25:013
470982993228,1cyclictest0-21swapper/309:25:003
470982992825,1cyclictest0-21swapper/311:30:013
470982992724,1cyclictest0-21swapper/310:00:003
470982992421,1cyclictest0-21swapper/311:35:003
470982992421,1cyclictest0-21swapper/311:25:003
147598230,5rtkit-daemon214-21plymouthd09:08:421
9112322221,13sleep0912382-21/usr/sbin/munin12:05:200
470982992219,1cyclictest0-21swapper/311:47:133
470982992219,1cyclictest0-21swapper/310:20:173
470982992216,2cyclictest8720922sleep311:40:263
470982992119,1cyclictest0-21swapper/309:55:013
470982992118,1cyclictest0-21swapper/309:20:003
470982992118,1cyclictest0-21swapper/307:50:023
47098299202,13cyclictest939584-21chrt12:25:133
470982992017,1cyclictest0-21swapper/310:50:003
470982992016,1cyclictest0-21swapper/311:55:013
47098299193,13cyclictest491891-21turbostat07:25:013
470982991917,1cyclictest0-21swapper/310:35:013
470982991917,1cyclictest0-21swapper/309:45:003
470982991916,1cyclictest0-21swapper/312:25:003
470982991916,1cyclictest0-21swapper/312:05:013
470982991916,1cyclictest0-21swapper/310:55:153
470982991916,1cyclictest0-21swapper/308:45:003
470982991816,1cyclictest0-21swapper/310:40:343
470982991816,1cyclictest0-21swapper/307:55:203
470982991816,1cyclictest0-21swapper/307:50:003
470982991815,1cyclictest0-21swapper/312:35:183
470982991815,1cyclictest0-21swapper/312:15:173
470982991815,1cyclictest0-21swapper/312:10:003
470982991815,1cyclictest0-21swapper/311:55:213
470982991815,1cyclictest0-21swapper/311:40:003
470982991815,1cyclictest0-21swapper/311:10:183
470982991815,1cyclictest0-21swapper/311:05:183
470982991815,1cyclictest0-21swapper/310:30:003
470982991815,1cyclictest0-21swapper/309:30:383
47098299181,13cyclictest512040-21taskset07:40:163
47098299180,13cyclictest598999-21taskset08:50:003
470982991715,1cyclictest0-21swapper/308:50:013
470982991714,1cyclictest0-21swapper/310:14:233
470982991714,1cyclictest0-21swapper/307:35:013
47098299171,13cyclictest801753-21taskset11:00:003
7673042161,7sleep2767312-21ssh10:36:052
7507142161,12sleep1750927-21grep10:25:261
47098299167,7cyclictest575476-21chrt08:30:163
470982991614,1cyclictest0-21swapper/309:00:163
470982991613,1cyclictest0-21swapper/310:06:563
470982991613,1cyclictest0-21swapper/309:05:193
470982991613,1cyclictest0-21swapper/308:25:183
470982991613,1cyclictest0-21swapper/308:20:013
470982991613,1cyclictest0-21swapper/308:02:423
47098299161,12cyclictest955267-21taskset12:34:463
47098299161,12cyclictest832426-21taskset11:17:013
47098299161,12cyclictest664394-21taskset09:35:093
47098299161,12cyclictest479996-21taskset07:15:153
47098299161,11cyclictest680450-21chrt09:45:063
47098299161,11cyclictest471258-21chrt07:10:143
47098299160,12cyclictest580271-21chrt08:35:103
7831222151,11sleep10-21swapper/110:45:261
470982991513,1cyclictest0-21swapper/310:50:203
470982991513,1cyclictest0-21swapper/310:36:523
470982991513,1cyclictest0-21swapper/309:25:173
470982991513,1cyclictest0-21swapper/308:06:593
470982991512,1cyclictest0-21swapper/312:10:133
470982991512,1cyclictest0-21swapper/308:20:123
47098299151,12cyclictest510304-21chrt07:35:263
47098299151,12cyclictest492610-21taskset07:25:163
47098299151,11cyclictest729159-21taskset10:15:123
47098299151,11cyclictest626002-21taskset09:10:173
47098299151,11cyclictest611155-21taskset08:57:453
47098299151,11cyclictest554619-21taskset08:11:533
47098299150,12cyclictest704896-21taskset10:00:103
6876942141,9sleep0687702-21ssh09:48:530
6697842130,9sleep0669895-21/usr/sbin/munin09:35:220
8749302120,4sleep0875052-21ssh11:45:150
7665452120,5sleep00-21swapper/010:35:230
7526882120,9sleep0752696-21ssh10:29:220
7058872125,3sleep1706840-21cut10:00:171
6981962120,9sleep2699316-21cut09:55:162
5046792120,3sleep0504834-21diskstats07:35:130
470982991210,1cyclictest0-21swapper/307:10:013
470982991210,1cyclictest0-21swapper/307:10:003
147598120,7rtkit-daemon313-21systemd-udevd10:20:421
8891452110,8sleep0720-21snmpd11:51:440
8570172110,8sleep0857025-21ssh11:32:140
7022902112,4sleep1631905-21kworker/u16:4+events_power_efficient09:55:231
5225142111,7sleep1517328-21/usr/sbin/munin07:45:241
4715432110,3sleep1214-21plymouthd07:10:181
147598110,7rtkit-daemon872368-21ssh11:40:272
147598110,2rtkit-daemon214-21plymouthd10:47:510
9153442100,8sleep1915348-21ssh12:10:051
9006542101,6sleep2900686-21kthreadcore12:00:172
8887682100,1sleep2623843-21diskmemload11:50:552
8504252101,5sleep1850460-21apt-get11:30:141
8012992100,1sleep20-21swapper/210:59:372
7915052100,7sleep2791513-21ssh10:50:392
7122002100,7sleep2712207-21sh10:03:552
6245912100,3sleep1624686-21irqcore09:10:161
147598100,7rtkit-daemon1540-21sendmail-mta11:26:152
147598100,6rtkit-daemon456-21avahi-daemon11:15:040
147598100,5rtkit-daemon924817-21irqstats12:15:180
147598100,5rtkit-daemon718279-21ntp_states10:05:232
147598100,2rtkit-daemon695443-21ssh09:53:102
147598100,2rtkit-daemon214-21plymouthd11:30:382
147598100,1rtkit-daemon0-21swapper/110:16:001
955919290,6sleep2956086-21gltestperf12:35:152
955743292,4sleep0955746-21apt-get12:35:130
921196290,6sleep2921204-21ssh12:10:422
898594293,4sleep2824627-21kworker/u16:0+nfsiod11:59:562
873930292,4sleep1800992-21kworker/u16:2+xprtiod11:43:571
866715292,4sleep0866739-21apt-get11:40:150
865154290,1sleep10-21swapper/111:37:181
799830290,6sleep1799837-21sh10:56:161
769037290,6sleep1769300-21latency_hist10:40:011
760818290,7sleep2760824-21ssh10:34:362
759128290,7sleep0759131-21sh10:30:370
663049290,1sleep00-21swapper/009:32:390
654162290,6sleep1654164-21ssh09:25:381
537381290,6sleep2538540-21grep08:00:152
536372291,4sleep1536405-21apt-get08:00:101
465873292,3sleep0466946-21tr07:05:200
465873292,3sleep0466946-21tr07:05:190
14759890,6rtkit-daemon515-21gmain11:00:492
14759890,5rtkit-daemon889989-21ssh11:53:431
14759890,5rtkit-daemon730-21ntpd07:55:232
14759890,4rtkit-daemon816717-21ssh11:07:520
14759890,4rtkit-daemon214-21plymouthd09:20:080
14759890,4rtkit-daemon214-21plymouthd09:20:070
14759890,4rtkit-daemon214-21plymouthd08:56:421
14759890,2rtkit-daemon214-21plymouthd08:32:081
14759890,1rtkit-daemon214-21plymouthd09:33:242
14759890,1rtkit-daemon0-21swapper/207:37:332
947642281,3sleep1947674-21apt-get12:30:121
945367281,5sleep2945373-21ssh12:25:302
944862280,5sleep0944995-21python312:25:240
913772280,6sleep10-21swapper/112:07:011
897194280,1sleep10-21swapper/111:56:421
896147281,4sleep0896280-21python311:55:220
841808284,2sleep0623843-21diskmemload11:25:000
841789280,6sleep2841797-21ssh11:24:582
810863280,5sleep1811861-21kthreadcore11:05:161
787795281,4sleep1789774-21cut10:50:181
769838280,1sleep00-21swapper/010:40:190
759132280,1sleep10-21swapper/110:30:381
734981280,5sleep2734989-21ssh10:15:562
728291280,1sleep20-21swapper/210:13:572
690371280,6sleep0692328-21cut09:50:180
678613284,2sleep0151ktimers/009:41:290
647232281,5sleep1647240-21ssh09:23:101
647232281,5sleep1647240-21ssh09:23:101
637512281,4sleep2637572-21ntp_states09:15:212
580289281,3sleep0580311-21apt-get08:35:150
523044280,1sleep00-21swapper/007:46:190
517555281,4sleep2517739-21/usr/sbin/munin07:45:162
491530280,1sleep00-21swapper/007:20:340
477160280,1sleep00-21swapper/007:14:490
14759880,5rtkit-daemon767473-21kworker/u16:4+rpciod12:30:332
14759880,5rtkit-daemon515-21gmain11:37:132
14759880,4rtkit-daemon938132-21ssh12:22:300
14759880,4rtkit-daemon817951-21chrt11:10:120
14759880,4rtkit-daemon730-21ntpd08:50:141
14759880,4rtkit-daemon729-21lldpd09:22:482
14759880,4rtkit-daemon729-21lldpd09:22:472
14759880,4rtkit-daemon726920-21ssh10:10:431
14759880,4rtkit-daemon720-21snmpd09:25:352
14759880,4rtkit-daemon529457-21grep07:50:232
14759880,4rtkit-daemon515-21gmain08:25:181
14759880,4rtkit-daemon478609-21cut07:15:022
14759880,4rtkit-daemon477370-21munin-node08:37:011
14759880,4rtkit-daemon476-21wpa_supplicant08:13:591
14759880,4rtkit-daemon313-21systemd-udevd12:06:422
14759880,4rtkit-daemon214-21plymouthd09:45:191
14759880,4rtkit-daemon214-21plymouthd09:02:351
14759880,4rtkit-daemon214-21plymouthd07:22:582
14759880,3rtkit-daemon556676-21kthreadcore08:15:181
14759880,1rtkit-daemon0-21swapper/207:42:022
14759880,1rtkit-daemon0-21swapper/207:30:392
915403270,4sleep00-21swapper/012:10:120
858736270,4sleep0858938-21hddtemp_smartct11:35:130
807582271,4sleep0623843-21diskmemload11:00:320
737061270,5sleep2554692-21kworker/u16:3+rpciod10:20:102
712658270,4sleep0712703-21systemd-run10:05:000
695196271,3sleep1695204-21ssh09:52:321
627938271,3sleep0629238-21memory09:10:180
612666271,3sleep0214-21plymouthd09:00:170
586855270,4sleep2586984-21irqcore08:40:142
586545270,4sleep0586700-21diskstats08:40:130
548600270,4sleep2548819-21date08:10:022
535293271,4sleep0535410-21python307:55:250
482263272,2sleep10-21swapper/107:15:181
468968271,3sleep2469800-21missed_timers07:05:212
468968271,3sleep2469800-21missed_timers07:05:212
14759870,4rtkit-daemon720-21snmpd08:42:351
14759870,4rtkit-daemon295-21systemd-journal07:25:002
14759870,4rtkit-daemon1-21systemd09:16:330
14759870,3rtkit-daemon295-21systemd-journal09:36:002
14759870,3rtkit-daemon1-21systemd12:24:422
14759870,3rtkit-daemon1-21systemd11:49:431
14759870,3rtkit-daemon1-21systemd10:08:401
14759870,3rtkit-daemon1-21systemd09:46:502
14759870,3rtkit-daemon1-21systemd09:41:142
14759870,3rtkit-daemon0-21swapper/210:25:042
14759870,2rtkit-daemon214-21plymouthd09:15:221
14759870,2rtkit-daemon214-21plymouthd08:21:221
14759870,1rtkit-daemon0-21swapper/207:14:212
14759870,1rtkit-daemon0-21swapper/108:45:451
906391260,4sleep0214-21plymouthd12:03:380
904927261,2sleep10-21swapper/112:00:231
874727260,2sleep2874762-21apt-get11:45:132
849047260,3sleep1849055-21ssh11:27:331
840308260,1sleep10-21swapper/111:21:371
833365260,1sleep20-21swapper/211:19:082
823829260,1sleep10-21swapper/111:10:421
821025261,3sleep2822930-21expr11:10:182
807163260,3sleep134-21ksoftirqd/111:00:241
784418260,1sleep20-21swapper/210:47:512
776670260,1sleep20-21swapper/210:43:292
743104260,1sleep00-21swapper/010:20:470
727237260,4sleep00-21swapper/010:11:330
704474260,1sleep00-21swapper/009:59:430
679024260,1sleep10-21swapper/109:42:221
662228260,1sleep10-21swapper/109:30:401
648409261,2sleep00-21swapper/009:25:130
623584260,1sleep00-21swapper/009:06:490
611287260,1sleep00-21swapper/008:59:280
610505260,3sleep2610628-21mailstats08:55:212
604894260,1sleep00-21swapper/008:53:080
598004260,4sleep0598115-21grep08:45:250
592756260,3sleep2592789-21apt-get08:45:152
573674260,1sleep00-21swapper/008:29:020
561420260,1sleep20-21swapper/208:20:022
544218260,3sleep0546200-21cut08:05:230
542324260,1sleep00-21swapper/008:04:340
529601260,1sleep00-21swapper/007:51:430
523849260,3sleep1523882-21apt-get07:50:121
491666260,1sleep10-21swapper/107:22:201
14759860,2rtkit-daemon214-21plymouthd08:05:421
957181251,2sleep1214-21plymouthd12:35:181
955070250,3sleep0955072-21ssh12:34:200
946653250,2sleep10-21swapper/112:28:291
929300250,3sleep2214-21plymouthd12:15:482
929133250,2sleep1929144-21ssh12:15:271
850085250,2sleep00-21swapper/011:30:000
827909250,2sleep10-21swapper/111:15:181
816630250,3sleep20-21swapper/211:07:432
798947251,2sleep0799006-21ntp_states10:55:220
776051250,3sleep10-21swapper/110:42:001
735471250,3sleep00-21swapper/010:16:590
714568250,2sleep00-21swapper/010:05:210
664411250,2sleep10-21swapper/109:35:111
625150251,2sleep20-21swapper/209:10:172
623832251,2sleep244-21ksoftirqd/209:10:002
599898251,2sleep20-21swapper/208:50:172
579989250,3sleep20-21swapper/208:34:412
573541250,3sleep20-21swapper/208:27:212
567370250,3sleep00-21swapper/008:23:500
549021250,3sleep20-21swapper/208:10:132
548854250,2sleep00-21swapper/008:10:110
513215250,2sleep00-21swapper/007:40:170
504385250,3sleep0504431-21munin-run07:35:000
498780250,2sleep10-21swapper/107:30:171
497801250,3sleep00-21swapper/007:25:540
497318250,3sleep1497431-21smartctl07:25:231
466948250,2sleep1468965-21kthreadcore07:05:211
466948250,2sleep1468965-21kthreadcore07:05:201
14759850,1rtkit-daemon0-21swapper/010:50:090
937941240,2sleep1937949-21ssh12:22:071
616893240,2sleep20-21swapper/209:00:232
579743240,2sleep00-21swapper/008:31:320
559878240,2sleep0560223-21strings08:15:210
556521240,2sleep20-21swapper/208:15:192
536047240,2sleep10-21swapper/107:59:231
510386240,2sleep1510387-21sshd07:36:291
477176240,2sleep0477503-21ps07:15:000
580260230,1sleep20-21swapper/208:35:022
511037230,1sleep10-21swapper/107:40:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional