You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 00:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8.osadl.org (updated Wed Nov 26, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
459219992422,1cyclictest0-21swapper/312:10:013
459219992421,1cyclictest0-21swapper/310:55:013
459219992219,1cyclictest0-21swapper/309:05:003
459219992118,1cyclictest0-21swapper/310:05:153
459219992118,1cyclictest0-21swapper/308:45:003
45921999211,14cyclictest486451-21taskset07:30:013
459219992017,1cyclictest0-21swapper/309:45:013
459219992016,1cyclictest0-21swapper/312:15:013
45921999201,15cyclictest790389-21chrt11:00:123
45921999201,14cyclictest511688-21turbostat07:50:013
45921999192,13cyclictest511963-21taskset07:50:123
45921999191,13cyclictest935726-21taskset12:30:003
45921999188,7cyclictest9342332sleep312:27:103
459219991815,1cyclictest0-21swapper/311:35:163
459219991815,1cyclictest0-21swapper/311:29:133
459219991815,1cyclictest0-21swapper/310:30:193
459219991815,1cyclictest0-21swapper/307:35:153
45921999181,13cyclictest757826-21taskset10:40:003
45921999181,13cyclictest725408-21taskset10:20:003
45921999181,12cyclictest518157-21taskset07:55:013
45921999180,13cyclictest459403-21taskset07:10:013
459219991715,1cyclictest0-21swapper/311:15:003
459219991714,1cyclictest0-21swapper/312:20:143
459219991714,1cyclictest0-21swapper/309:45:193
459219991714,1cyclictest0-21swapper/309:25:163
459219991714,1cyclictest0-21swapper/307:20:253
459219991713,1cyclictest0-21swapper/309:35:003
45921999171,13cyclictest823190-21taskset11:20:153
45921999171,13cyclictest806137-21turbostat11:10:003
45921999171,13cyclictest806137-21turbostat11:10:003
45921999171,12cyclictest676877-21sleep09:54:553
45921999171,12cyclictest543667-21chrt08:15:133
45921999171,11cyclictest653061-21taskset09:35:123
147598170,3rtkit-daemon1540-21sendmail-mta07:31:461
459219991613,1cyclictest0-21swapper/311:55:123
459219991613,1cyclictest0-21swapper/309:17:083
459219991613,1cyclictest0-21swapper/308:45:193
459219991613,1cyclictest0-21swapper/308:25:153
459219991612,1cyclictest0-21swapper/308:20:193
45921999161,12cyclictest919260-21sleep12:19:593
45921999161,12cyclictest845009-21chrt11:31:143
45921999161,12cyclictest772827-21taskset10:47:253
45921999161,12cyclictest715146-21taskset10:10:263
45921999161,12cyclictest691173-21taskset09:55:513
45921999161,12cyclictest612116-21taskset09:06:143
45921999161,12cyclictest504749-21chrt07:40:233
45921999161,12cyclictest467004-21taskset07:15:023
45921999161,11cyclictest860887-21chrt11:40:313
45921999161,11cyclictest542923-21taskset08:11:083
45921999160,13cyclictest763974-21taskset10:40:403
45921999160,12cyclictest895034-21taskset12:04:563
45921999160,12cyclictest871111-21chrt11:50:013
45921999160,12cyclictest593627-21taskset08:55:123
45921999160,12cyclictest536366-21taskset08:05:433
459219991512,1cyclictest0-21swapper/309:20:053
45921999151,12cyclictest732550-21chrt10:23:013
45921999151,12cyclictest465394-21taskset07:13:383
45921999151,11cyclictest949722-21taskset12:35:373
45921999151,11cyclictest868887-21chrt11:45:243
45921999151,11cyclictest619325-21taskset09:12:193
45921999151,11cyclictest562225-21taskset08:30:043
45921999151,11cyclictest529711-21taskset08:00:223
45921999151,11cyclictest492432-21taskset07:31:533
45921999150,12cyclictest814525-21chrt11:15:103
45921999150,12cyclictest734160-21chrt10:25:133
45921999150,12cyclictest574554-21turbostat08:40:003
7527982140,1sleep1754903-21grep10:35:181
45921999141,11cyclictest699187-21chrt10:00:443
45921999141,11cyclictest592971-21chrt08:50:233
45921999141,10cyclictest782656-21taskset10:55:153
147598140,6rtkit-daemon612419-21diskmemload09:50:540
8534042139,2sleep00-21swapper/011:37:000
7422202130,6sleep0214-21plymouthd10:30:160
6440972131,9sleep0644105-21ssh09:28:520
6302932131,9sleep2631847-21cut09:20:172
7980402121,7sleep2798259-21grep11:05:002
7832162120,2sleep00-21swapper/010:55:170
7078162120,9sleep0707824-21ssh10:07:000
6370822120,9sleep2636880-21/usr/sbin/munin09:25:182
5691042120,9sleep1569961-21grep08:35:161
4627002121,8sleep10-21swapper/107:10:201
4579472120,2sleep2214-21plymouthd07:05:202
147598120,9rtkit-daemon720-21snmpd11:43:521
147598120,8rtkit-daemon740272-21ssh10:26:390
9452742110,8sleep1946455-21grep12:35:161
9417612112,6sleep1764199-21kworker/u16:0+xprtiod12:30:551
6837812110,7sleep1683789-21ssh09:52:261
5367002111,7sleep21-21systemd08:10:002
4657322111,3sleep2467003-21cut07:15:022
147598110,7rtkit-daemon933740-21diskmemload12:25:572
147598110,7rtkit-daemon868457-21processes11:45:210
147598110,7rtkit-daemon1-21systemd08:06:420
147598110,6rtkit-daemon926765-21ssh12:23:372
147598110,6rtkit-daemon911494-21apt-get12:15:131
147598110,3rtkit-daemon720-21snmpd09:48:500
147598110,3rtkit-daemon1-21systemd08:30:480
5995732100,7sleep1599607-21awk09:00:001
5937712101,6sleep0593815-21fschecks_count08:55:140
147598100,6rtkit-daemon943120-21ssh12:34:012
147598100,6rtkit-daemon896853-21ps12:05:170
147598100,6rtkit-daemon515-21gmain10:13:571
147598100,6rtkit-daemon476-21wpa_supplicant11:23:070
147598100,6rtkit-daemon1540-21sendmail-mta12:14:501
147598100,6rtkit-daemon1540-21sendmail-mta10:03:551
147598100,5rtkit-daemon877227-21ssh11:51:090
147598100,5rtkit-daemon839034-21apt-get11:30:101
147598100,5rtkit-daemon474151-21apt-get07:20:151
147598100,3rtkit-daemon720-21snmpd07:54:521
147598100,3rtkit-daemon214-21plymouthd11:11:502
147598100,2rtkit-daemon214-21plymouthd10:37:310
910795291,2sleep00-21swapper/012:14:110
885346290,6sleep0885351-21sh11:56:120
814536291,4sleep0814570-21apt-get11:15:120
557773290,6sleep1559748-21grep08:25:181
524153290,6sleep0524332-21latency_hist08:00:010
511927291,4sleep2511960-21apt-get07:50:122
14759890,6rtkit-daemon1540-21sendmail-mta08:03:060
14759890,5rtkit-daemon720-21snmpd09:38:501
14759890,5rtkit-daemon504230-21kthreadcore07:40:181
14759890,5rtkit-daemon22110-21packagekitd09:14:142
14759890,5rtkit-daemon214-21plymouthd11:08:262
14759890,5rtkit-daemon214-21plymouthd11:08:262
14759890,4rtkit-daemon949262-21python312:35:212
14759890,4rtkit-daemon852186-21/usr/sbin/munin11:35:201
14759890,4rtkit-daemon523307-21ntp_states07:55:201
14759890,2rtkit-daemon837313-21ssh11:27:221
14759890,2rtkit-daemon214-21plymouthd08:29:100
14759890,2rtkit-daemon0-21swapper/210:59:442
14759890,1rtkit-daemon0-21swapper/208:48:402
901743280,6sleep2901752-21sshd12:06:482
871195281,4sleep2871230-21apt-get11:50:132
868547280,5sleep1868756-21unixbench-2d11:45:231
821054282,4sleep2814451-21kworker/u16:3+xprtiod11:17:112
814197281,2sleep0214-21plymouthd11:15:000
797406281,4sleep0214-21plymouthd11:03:340
733360281,4sleep1733434-21munin-run10:25:001
714799280,5sleep0714998-21cat10:10:240
691950280,6sleep1691958-21ssh09:57:471
668280280,5sleep2668287-21diskmemload09:43:452
653016282,3sleep2653051-21apt-get09:35:122
544881280,5sleep2546133-21kthreadcore08:15:182
498074281,4sleep1498116-21ntp_states07:35:211
14759880,5rtkit-daemon465730-21munin-node08:58:322
14759880,4rtkit-daemon779659-21/usr/sbin/munin10:50:220
14759880,4rtkit-daemon730-21ntpd10:25:000
14759880,4rtkit-daemon730-21ntpd08:15:120
14759880,4rtkit-daemon465730-21munin-node09:59:160
14759880,4rtkit-daemon465730-21munin-node09:22:580
14759880,4rtkit-daemon214-21plymouthd10:19:461
14759880,3rtkit-daemon612419-21diskmemload10:40:140
14759880,3rtkit-daemon214-21plymouthd12:03:120
14759880,1rtkit-daemon0-21swapper/211:24:322
14759880,1rtkit-daemon0-21swapper/209:02:482
14759880,1rtkit-daemon0-21swapper/208:54:042
14759880,1rtkit-daemon0-21swapper/110:05:041
14759880,1rtkit-daemon0-21swapper/109:40:401
14759880,1rtkit-daemon0-21swapper/010:46:500
942582270,5sleep0942589-21sh12:32:470
927867270,5sleep0927898-21/usr/sbin/munin12:25:130
900761270,4sleep10-21swapper/112:05:241
838443270,4sleep2838470-21apt-get11:30:012
815968271,3sleep1817620-21ps11:15:171
813055271,4sleep1612419-21diskmemload11:12:221
798798271,3sleep0799509-21cut11:05:150
798798271,3sleep0799509-21cut11:05:140
797704270,4sleep1797712-21ssh11:04:111
780245270,4sleep2780252-21sh10:51:022
775675271,3sleep10-21swapper/110:50:171
757810270,4sleep2757822-21cron10:40:002
735387270,4sleep2736772-21cat10:25:172
733960271,3sleep1214-21plymouthd10:25:121
732316270,1sleep20-21swapper/210:22:322
716519270,1sleep20-21swapper/210:13:352
655803271,4sleep0657877-21tr09:35:190
646328270,4sleep0647714-21tr09:30:170
636923271,3sleep1637081-21df_inode09:25:171
628864271,2sleep10-21swapper/109:20:121
580464270,1sleep00-21swapper/008:40:320
574244270,1sleep00-21swapper/008:36:190
530301270,1sleep20-21swapper/208:03:192
504513270,4sleep0504584-21ntp_states07:40:200
492935271,2sleep0492968-21apt-get07:35:120
486309270,1sleep20-21swapper/207:28:442
467894271,3sleep0468050-21diskstats07:15:160
14759870,4rtkit-daemon788785-21ssh10:57:121
14759870,4rtkit-daemon22110-21packagekitd07:06:231
14759870,3rtkit-daemon918287-21ssh12:17:472
14759870,3rtkit-daemon730-21ntpd08:35:402
14759870,3rtkit-daemon729-21lldpd09:19:342
14759870,3rtkit-daemon720-21snmpd07:17:271
14759870,3rtkit-daemon626039-21ntp_states09:15:210
14759870,3rtkit-daemon456-21avahi-daemon08:22:430
14759870,3rtkit-daemon214-21plymouthd11:44:350
14759870,3rtkit-daemon214-21plymouthd09:45:111
14759870,3rtkit-daemon1-21systemd10:00:520
14759870,3rtkit-daemon1-21systemd09:08:592
14759870,3rtkit-daemon1-21systemd08:40:412
14759870,3rtkit-daemon1-21systemd08:00:441
14759870,3rtkit-daemon1-21systemd07:45:181
14759870,3rtkit-daemon1-21systemd07:25:101
14759870,2rtkit-daemon214-21plymouthd08:11:130
924910261,2sleep10-21swapper/112:20:211
920559261,3sleep0921564-21grep12:20:160
917947260,1sleep00-21swapper/012:17:000
894278260,1sleep20-21swapper/212:03:112
886666260,3sleep2886674-21ssh11:59:232
879205260,2sleep1879229-21apt-get11:55:141
863122260,2sleep2863157-21apt-get11:45:122
855050260,3sleep2855058-21ssh11:40:112
849348261,3sleep2851389-21tr11:35:182
799511260,3sleep1800670-21grep11:05:151
799511260,3sleep1800670-21grep11:05:151
766141260,3sleep1766182-21ssh10:45:121
764640262,2sleep134-21ksoftirqd/110:42:151
763441261,3sleep2763550-21mailstats10:40:252
723415260,1sleep20-21swapper/210:15:432
718486260,3sleep0719616-21cat10:15:170
699373261,2sleep2699381-21ssh10:01:082
691579262,2sleep2612419-21diskmemload09:56:532
683858260,4sleep2683866-21ssh09:52:352
675928260,1sleep20-21swapper/209:47:542
668297260,1sleep00-21swapper/009:43:470
651446260,1sleep20-21swapper/209:32:072
617956261,3sleep1618035-21ssh09:10:221
607608261,2sleep00-21swapper/009:05:160
605517260,1sleep00-21swapper/009:00:390
581074261,1sleep00-21swapper/008:45:120
556001260,1sleep20-21swapper/208:25:032
554832260,3sleep2554909-21ntp_states08:20:222
543484260,3sleep1543517-21apt-get08:15:121
509453260,3sleep2510639-21memory07:45:192
505686260,1sleep00-21swapper/007:45:090
499055260,1sleep20-21swapper/207:39:102
486297260,1sleep00-21swapper/007:28:340
465370260,1sleep00-21swapper/007:13:210
14759860,3rtkit-daemon214-21plymouthd08:34:202
14759860,2rtkit-daemon0-21swapper/211:26:022
943841250,2sleep0943878-21apt-get12:35:110
934440251,2sleep1214-21plymouthd12:27:351
904439250,2sleep20-21swapper/212:10:172
894547251,2sleep1720-21snmpd12:03:501
877022250,2sleep1877030-21ssh11:50:361
828748250,1sleep10-21swapper/111:21:061
772389250,2sleep2214-21plymouthd10:46:292
747095250,2sleep20-21swapper/210:30:222
746583250,3sleep1742029-21/usr/sbin/munin10:30:221
707580250,3sleep2707588-21ssh10:06:292
651743250,3sleep1651748-21sh09:32:541
626740250,3sleep1626748-21ssh09:15:511
613160250,2sleep0613283-21ps09:10:170
612268250,1sleep10-21swapper/109:08:141
593235250,3sleep10-21swapper/108:53:471
586988250,3sleep10-21swapper/108:49:181
537878250,2sleep20-21swapper/208:10:162
537612250,2sleep1214-21plymouthd08:10:151
532097251,2sleep1530698-21/usr/sbin/munin08:05:191
519568251,2sleep20-21swapper/207:55:172
514941251,2sleep00-21swapper/007:50:180
505359250,3sleep20-21swapper/207:44:072
479951250,3sleep00-21swapper/007:22:490
475340250,2sleep20-21swapper/207:20:192
836636240,2sleep0214-21plymouthd11:25:500
589865240,2sleep00-21swapper/008:50:180
574991240,2sleep1575034-21grep08:40:161
492517240,2sleep0214-21plymouthd07:32:590
487336240,2sleep2488100-21kthreadcore07:30:182
464458240,2sleep2464575-21strings07:10:212
455336240,1sleep00-21swapper/007:05:180
839032230,1sleep00-21swapper/011:30:110
599841230,1sleep10-21swapper/109:00:051
562234230,1sleep10-21swapper/108:30:111
549749230,1sleep10-21swapper/108:20:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional