You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 08:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8.osadl.org (updated Fri Nov 21, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
664976993127,1cyclictest0-21swapper/320:00:013
664976992825,1cyclictest0-21swapper/323:40:003
664976992320,1cyclictest0-21swapper/321:25:003
664976992320,1cyclictest0-21swapper/320:35:013
664976992319,2cyclictest755295-21turbostat20:20:003
66497699221,16cyclictest1061386-21taskset23:40:133
664976992119,0cyclictest0-21swapper/300:20:003
664976992118,1cyclictest0-21swapper/322:55:023
664976992018,1cyclictest0-21swapper/322:05:013
664976992017,1cyclictest0-21swapper/322:45:133
664976992017,1cyclictest0-21swapper/321:35:193
664976992017,1cyclictest0-21swapper/319:35:003
664976992017,1cyclictest0-21swapper/300:10:003
10124962201,9sleep01012655-21df_inode23:10:130
66497699198,8cyclictest679555-21turbostat19:20:013
664976991916,1cyclictest0-21swapper/322:35:003
664976991916,1cyclictest0-21swapper/320:30:013
664976991916,1cyclictest0-21swapper/319:40:133
664976991916,1cyclictest0-21swapper/319:40:003
664976991916,1cyclictest0-21swapper/300:20:213
664976991915,1cyclictest0-21swapper/320:25:003
664976991816,1cyclictest0-21swapper/322:45:023
664976991815,1cyclictest0-21swapper/323:25:003
664976991815,1cyclictest0-21swapper/321:45:003
664976991815,1cyclictest0-21swapper/320:45:193
664976991815,1cyclictest0-21swapper/319:50:013
664976991815,1cyclictest0-21swapper/319:50:003
664976991815,1cyclictest0-21swapper/319:25:173
66497699181,13cyclictest1109782-21taskset00:10:153
66497699181,13cyclictest1085805-21taskset23:55:153
66497699181,13cyclictest1020073-21taskset23:14:563
109332921814,2sleep20-21swapper/200:00:002
664976991715,1cyclictest0-21swapper/320:10:273
664976991714,1cyclictest0-21swapper/323:25:133
664976991714,1cyclictest0-21swapper/323:15:173
664976991714,1cyclictest0-21swapper/322:24:433
664976991714,1cyclictest0-21swapper/319:55:003
664976991714,1cyclictest0-21swapper/319:10:173
664976991714,1cyclictest0-21swapper/300:35:193
66497699171,12cyclictest923758-21taskset22:15:053
66497699171,12cyclictest1085195-21taskset23:54:553
66497699171,11cyclictest793708-21chrt20:50:133
66497699170,14cyclictest818518-21turbostat21:09:593
9481802161,11sleep2948356-21iwlist22:30:172
6786982160,9sleep0678804-21sendmail_mailtr19:15:220
664976991613,1cyclictest0-21swapper/323:30:153
664976991613,1cyclictest0-21swapper/321:56:543
664976991613,1cyclictest0-21swapper/321:55:003
664976991613,1cyclictest0-21swapper/321:10:123
664976991613,1cyclictest0-21swapper/319:20:113
66497699161,12cyclictest994954-21taskset22:57:253
66497699161,12cyclictest962817-21taskset22:37:293
66497699161,12cyclictest945773-21taskset22:25:433
66497699161,12cyclictest921714-21chrt22:10:483
66497699161,12cyclictest848989-21taskset21:25:493
66497699161,12cyclictest826851-21taskset21:15:033
66497699161,12cyclictest812262-21turbostat21:05:003
66497699161,12cyclictest786934-21turbostat20:45:013
66497699161,12cyclictest730420-21chrt20:00:043
66497699161,12cyclictest1141726-21sleep00:34:553
66497699161,12cyclictest1136804-21chrt00:25:173
66497699161,12cyclictest1101103-21chrt00:04:143
66497699160,13cyclictest780626-21turbostat20:40:003
76778721510,3sleep11-21systemd20:30:001
664976991513,1cyclictest0-21swapper/323:45:213
664976991513,1cyclictest0-21swapper/323:05:253
664976991512,1cyclictest0-21swapper/320:05:173
66497699151,12cyclictest915217-21taskset22:09:253
66497699151,12cyclictest915217-21taskset22:09:243
66497699151,12cyclictest881856-21chrt21:46:313
66497699151,12cyclictest805706-21taskset20:57:143
66497699150,12cyclictest851108-21chrt21:30:123
66497699150,12cyclictest1002151-21taskset23:00:253
147598140,10rtkit-daemon858382-21ssh21:33:580
147598130,1rtkit-daemon0-21swapper/023:54:110
10775632131,3sleep10-21swapper/123:50:141
9007372120,8sleep1901560-21grep22:00:171
8283312121,8sleep2830139-21grep21:15:192
8256162120,9sleep2825622-21ssh21:12:492
7878362120,9sleep0788360-21cut20:45:190
147598120,8rtkit-daemon1540-21sendmail-mta22:03:350
10866492124,4sleep11087758-21kthreadcore23:55:181
9821532110,8sleep1984121-21grep22:50:181
9651792111,7sleep2966042-21cut22:40:182
9537162110,1sleep00-21swapper/022:30:330
9471822111,7sleep0947190-21ssh22:29:050
8511602110,8sleep1851277-21grep21:30:151
7174072113,4sleep0214-21plymouthd19:50:000
7174072113,4sleep0214-21plymouthd19:50:000
66497699119,1cyclictest0-21swapper/319:10:003
147598110,7rtkit-daemon515-21gmain21:22:120
147598110,4rtkit-daemon671342-21munin-node19:52:341
147598110,1rtkit-daemon0-21swapper/022:18:490
10533702110,8sleep11053685-21sed23:35:191
9899622101,6sleep1991894-21kthreadcore22:55:191
9092232100,7sleep0911144-21grep22:05:170
9092232100,7sleep0911144-21grep22:05:170
8815032100,5sleep1881508-21sh21:45:381
7732882100,7sleep2773417-21netstat20:30:262
147598100,6rtkit-daemon715590-21kthreadcore19:45:171
147598100,6rtkit-daemon715590-21kthreadcore19:45:171
147598100,6rtkit-daemon214-21plymouthd00:00:581
147598100,6rtkit-daemon1540-21sendmail-mta20:46:361
147598100,6rtkit-daemon1066357-21latency23:40:200
147598100,5rtkit-daemon1076611-21ssh23:48:350
147598100,3rtkit-daemon729-21lldpd21:39:320
11242802101,7sleep21124286-21ssh00:16:592
10437642100,7sleep11043772-21ssh23:28:091
10033432100,7sleep01003351-21ssh23:03:120
894879290,2sleep10-21swapper/121:55:201
741874290,6sleep2741926-21ps20:05:212
706287290,6sleep0708075-21kthreadcore19:40:150
693695290,6sleep1694896-21kthreadcore19:30:181
14759890,6rtkit-daemon214-21plymouthd22:22:500
14759890,5rtkit-daemon818767-21ssh21:10:021
14759890,5rtkit-daemon720-21snmpd22:10:530
14759890,5rtkit-daemon720-21snmpd19:08:481
14759890,5rtkit-daemon22110-21packagekitd20:44:321
14759890,5rtkit-daemon0-21swapper/119:24:361
14759890,4rtkit-daemon988851-21idleruntime22:55:162
14759890,4rtkit-daemon720-21snmpd23:32:420
14759890,4rtkit-daemon686483-21awk19:25:161
14759890,4rtkit-daemon671342-21munin-node21:44:240
14759890,3rtkit-daemon515-21gmain20:54:441
14759890,2rtkit-daemon214-21plymouthd00:22:362
14759890,1rtkit-daemon0-21swapper/119:18:051
1150084291,4sleep01150125-21apt-get00:35:130
1124023290,6sleep11124031-21ssh00:16:261
1101741291,5sleep01101778-21apt-get00:05:110
1094697291,5sleep01095546-21grep00:00:180
1047219290,6sleep11049264-21kthreadcore23:30:181
968042281,4sleep0969309-21memory22:40:190
964229280,4sleep1964268-21apt-get22:40:121
962408282,4sleep1825217-21kworker/u16:4+rpciod22:36:281
950046280,5sleep1952042-21grep22:30:201
939534280,6sleep2939542-21ssh22:24:592
886060280,5sleep1888084-21kthreadcore21:50:201
881417280,6sleep2720-21snmpd21:45:272
843046281,4sleep2843085-21apt-get21:25:112
806213281,3sleep0806235-21apt-get21:00:130
749274280,4sleep1749307-21apt-get20:15:141
14759880,4rtkit-daemon978273-21ssh22:45:570
14759880,4rtkit-daemon883025-21ssh21:49:160
14759880,4rtkit-daemon843452-21head21:25:140
14759880,4rtkit-daemon818510-21diskmemload00:12:130
14759880,4rtkit-daemon671342-21munin-node23:20:071
14759880,4rtkit-daemon515-21gmain19:13:361
14759880,4rtkit-daemon214-21plymouthd22:53:452
14759880,4rtkit-daemon214-21plymouthd21:53:180
14759880,4rtkit-daemon0-21swapper/222:38:332
14759880,4rtkit-daemon0-21swapper/120:59:051
14759880,4rtkit-daemon0-21swapper/120:09:061
14759880,4rtkit-daemon0-21swapper/120:03:431
14759880,3rtkit-daemon664970-21cyclictest23:37:120
14759880,3rtkit-daemon1140593-21ssh00:27:242
14759880,1rtkit-daemon0-21swapper/123:05:441
14759880,1rtkit-daemon0-21swapper/119:36:441
14759880,1rtkit-daemon0-21swapper/100:36:211
14759880,1rtkit-daemon0-21swapper/022:59:100
1142036280,6sleep01142045-21ssh00:30:120
1134009281,3sleep11134046-21apt-get00:25:131
1133534281,4sleep01133536-21ssh00:24:430
1079150280,5sleep21081100-21kthreadcore23:50:192
1076341284,2sleep11067118-21kworker/u16:4+nfsiod23:48:011
1028810281,4sleep01028845-21apt-get23:20:150
1020428281,3sleep11020469-21apt-get23:15:121
956251270,4sleep0956415-21diskstats22:35:140
940368270,1sleep2214-21plymouthd22:25:192
929169270,4sleep1923820-21/usr/sbin/munin22:15:241
922227270,4sleep1922235-21ssh22:12:031
905583270,5sleep2905591-21ssh22:00:392
865097270,4sleep1865105-21ssh21:35:401
841678270,5sleep20-21swapper/221:22:352
832299270,4sleep0832551-21sed21:15:240
807604271,3sleep10-21swapper/121:00:181
793660270,1sleep00-21swapper/020:50:030
743023271,4sleep1743176-21df_inode20:10:181
724192271,3sleep0724225-21apt-get19:55:130
718888271,3sleep00-21swapper/019:50:160
704593270,4sleep2704793-21sed19:40:002
703671270,4sleep0703748-21ntp_states19:35:210
682398270,4sleep2684538-21kthreadcore19:20:172
671072270,1sleep20-21swapper/219:14:042
665533271,3sleep0214-21plymouthd19:10:170
14759870,4rtkit-daemon730-21ntpd21:07:351
14759870,4rtkit-daemon729-21lldpd23:22:462
14759870,3rtkit-daemon985778-21python322:50:230
14759870,3rtkit-daemon758224-21grep20:20:191
14759870,3rtkit-daemon214-21plymouthd23:56:240
14759870,3rtkit-daemon214-21plymouthd23:10:161
14759870,3rtkit-daemon214-21plymouthd23:04:201
14759870,3rtkit-daemon214-21plymouthd19:40:141
14759870,3rtkit-daemon214-21plymouthd00:34:491
14759870,3rtkit-daemon1-21systemd20:38:211
14759870,3rtkit-daemon1-21systemd19:58:101
14759870,3rtkit-daemon1-21systemd00:30:252
14759870,3rtkit-daemon1123082-21ntpq00:15:230
14759870,2rtkit-daemon214-21plymouthd20:30:011
14759870,1rtkit-daemon0-21swapper/021:56:010
1151562270,4sleep21153491-21grep00:35:202
1115734271,3sleep21115741-21sshd00:10:542
1061342271,2sleep21061379-21apt-get23:40:132
1050328270,1sleep20-21swapper/223:30:232
978242260,4sleep1825217-21kworker/u16:4+rpciod22:45:491
945757260,1sleep10-21swapper/122:25:421
939156260,1sleep10-21swapper/122:24:021
930119260,1sleep20-21swapper/222:16:412
923013260,4sleep2857887-21kworker/u16:2+rpciod22:13:522
898368260,1sleep20-21swapper/221:57:332
867567260,4sleep1867573-21ssh21:40:101
859651260,3sleep2860594-21irqstats21:35:172
858626260,1sleep20-21swapper/221:34:292
849398260,1sleep10-21swapper/121:26:471
832922260,4sleep10-21swapper/121:16:011
818264260,1sleep00-21swapper/021:07:020
799908261,2sleep20-21swapper/220:55:062
793247261,2sleep20-21swapper/220:47:532
786842260,1sleep00-21swapper/020:44:060
775050260,3sleep0775976-21irqstats20:35:160
774258260,1sleep00-21swapper/020:34:160
761546261,2sleep20-21swapper/220:25:012
736148260,1sleep20-21swapper/220:01:202
710837260,1sleep20-21swapper/219:44:092
697973260,1sleep00-21swapper/019:30:300
685467260,1sleep00-21swapper/019:21:070
1116168260,1sleep10-21swapper/100:11:571
1101941260,3sleep21102035-21fschecks_time00:05:132
1075714261,3sleep21075722-21ssh23:46:342
1068841260,4sleep10-21swapper/123:44:251
1058160260,4sleep20-21swapper/223:35:242
1042026261,2sleep01042109-21ntp_states23:25:200
1037041261,3sleep21037162-21perl23:25:152
1027102260,4sleep2946751-21kworker/u16:0+nfsiod23:17:252
1019314260,1sleep20-21swapper/223:13:032
1003297260,4sleep21003305-21ssh23:03:062
979968250,3sleep20-21swapper/222:49:512
914469250,2sleep10-21swapper/122:07:421
914469250,2sleep10-21swapper/122:07:421
890709250,3sleep20-21swapper/221:53:222
841923250,3sleep1841931-21ssh21:23:061
812890250,3sleep2813359-21sed21:05:172
811879250,3sleep20-21swapper/221:00:312
801339251,2sleep00-21swapper/020:55:250
793673251,2sleep20-21swapper/220:50:132
780875250,3sleep20-21swapper/220:40:072
780253250,1sleep20-21swapper/220:35:302
767490250,3sleep20-21swapper/220:26:132
742987250,2sleep00-21swapper/020:10:170
694898250,2sleep20-21swapper/219:30:192
687432250,3sleep2688809-21cat19:25:182
660892250,2sleep20-21swapper/219:05:192
1140766250,3sleep00-21swapper/000:27:480
1026332253,1sleep00-21swapper/023:15:380
1009781250,2sleep20-21swapper/223:05:262
1004333250,3sleep00-21swapper/023:05:050
915336240,2sleep2915344-21ssh22:09:482
915336240,2sleep2915344-21ssh22:09:482
867513240,2sleep2867522-21ssh21:40:022
825178240,2sleep0214-21plymouthd21:11:470
755192240,3sleep00-21swapper/020:19:090
750237240,1sleep20-21swapper/220:15:192
736419240,3sleep00-21swapper/020:04:480
729887240,2sleep2214-21plymouthd19:56:392
711051240,1sleep20-21swapper/219:45:022
711051240,1sleep20-21swapper/219:45:012
658879240,1sleep00-21swapper/019:05:120
1132956240,2sleep11132964-21ssh00:23:241
1103175240,2sleep10-21swapper/100:05:161
1099066240,1sleep20-21swapper/200:00:252
761842230,1sleep00-21swapper/020:25:150
755534230,1sleep00-21swapper/020:20:100
743177230,1sleep20-21swapper/220:10:182
736690230,1sleep00-21swapper/020:05:070
718125230,1sleep2214-21plymouthd19:50:142
686021230,1sleep00-21swapper/019:25:040
673501230,1sleep20-21swapper/219:15:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional