You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 11:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Wed Dec 03, 2025 00:46:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8742692126121,2sleep10-21swapper/119:05:251
87276021060,4sleep0111rcuc/019:05:150
216999980,50rtkit-daemon0-21swapper/419:08:484
9761742850,2sleep656-21ksoftirqd/621:29:326
9761742850,2sleep656-21ksoftirqd/621:29:326
875474998516,37cyclictest0-21swapper/500:33:155
875474998516,36cyclictest0-21swapper/523:23:155
11049722850,0sleep40-21swapper/423:10:234
875474998315,38cyclictest0-21swapper/520:43:155
875474998115,35cyclictest0-21swapper/519:18:155
87516928142,13sleep20-21swapper/219:08:402
875474998015,35cyclictest0-21swapper/519:53:155
875481997915,37cyclictest0-21swapper/623:13:156
87547499789,41cyclictest49-21ksoftirqd/522:28:155
875467997815,34cyclictest0-21swapper/423:48:154
875467997615,34cyclictest0-21swapper/422:13:154
8986922750,0sleep60-21swapper/619:45:126
875467997416,33cyclictest0-21swapper/421:18:154
11577372730,0sleep10-21swapper/123:54:501
10535912730,2sleep656-21ksoftirqd/622:30:126
87516327246,13sleep50-21swapper/519:08:355
87497927043,13sleep30-21swapper/319:05:593
87496227043,12sleep60-21swapper/619:05:476
87517426843,12sleep70-21swapper/719:08:457
9615382660,0sleep50-21swapper/521:16:585
10221252660,0sleep50-21swapper/522:05:125
8888792650,0sleep00-21swapper/019:30:000
875448996411,22cyclictest0-21swapper/221:03:162
875474996316,35cyclictest0-21swapper/519:33:155
9724502620,0sleep20-21swapper/221:25:202
9724502620,0sleep20-21swapper/221:25:202
11625022620,0sleep00-21swapper/023:57:450
87548199436,12cyclictest0-21swapper/622:03:156
875441993735,1cyclictest0-21swapper/120:18:151
875481993612,24cyclictest0-21swapper/619:38:586
875467993511,24cyclictest0-21swapper/419:14:584
875441993511,24cyclictest0-21swapper/122:11:581
875481993411,0cyclictest0-21swapper/620:46:586
875436993411,0cyclictest0-21swapper/000:18:590
875436993411,0cyclictest0-21swapper/000:18:590
875436993410,24cyclictest0-21swapper/022:53:590
875436993410,24cyclictest0-21swapper/022:53:590
87546799339,24cyclictest0-21swapper/420:31:584
87544199339,24cyclictest0-21swapper/120:42:581
87544199338,24cyclictest0-21swapper/120:47:581
8994292320,0sleep00-21swapper/019:45:140
87546799320,32cyclictest0-21swapper/423:20:254
875441993214,18cyclictest0-21swapper/121:53:151
87543699328,24cyclictest0-21swapper/021:16:580
9853582310,0sleep10-21swapper/121:35:201
875481993115,15cyclictest0-21swapper/620:03:156
875481993115,15cyclictest0-21swapper/620:03:156
87546799317,24cyclictest0-21swapper/421:55:584
87544199317,24cyclictest0-21swapper/123:32:591
875474993014,15cyclictest0-21swapper/523:43:155
875474993014,15cyclictest0-21swapper/500:18:155
875474993014,15cyclictest0-21swapper/500:18:155
87546799306,24cyclictest0-21swapper/420:26:584
875448993014,15cyclictest0-21swapper/222:53:152
875448993014,15cyclictest0-21swapper/222:53:152
875467992913,15cyclictest0-21swapper/419:48:154
875448992913,15cyclictest0-21swapper/220:53:152
87544199295,24cyclictest0-21swapper/123:13:591
87544199295,24cyclictest0-21swapper/100:20:591
875441992913,15cyclictest0-21swapper/119:38:151
875436992913,15cyclictest0-21swapper/023:28:150
11677942290,0sleep20-21swapper/200:01:242
875481992811,16cyclictest0-21swapper/600:38:156
875474992813,14cyclictest0-21swapper/520:33:155
87544199284,24cyclictest0-21swapper/100:11:591
875441992812,15cyclictest0-21swapper/119:23:151
9465152270,0sleep7621rcuc/721:00:187
87543699273,24cyclictest0-21swapper/022:09:580
87548199269,16cyclictest0-21swapper/622:23:156
87548199263,0cyclictest0-21swapper/621:09:586
875474992610,15cyclictest0-21swapper/521:43:155
875448992610,15cyclictest0-21swapper/219:43:152
87544199262,24cyclictest0-21swapper/120:53:581
87548199251,24cyclictest0-21swapper/619:29:586
87547499259,15cyclictest0-21swapper/521:08:155
87544899259,15cyclictest0-21swapper/223:08:142
875436992515,10cyclictest0-21swapper/022:48:150
875481992423,1cyclictest2107-21gnome-shell19:10:596
87548199240,0cyclictest0-21swapper/623:16:596
87548199240,0cyclictest0-21swapper/600:19:596
87548199240,0cyclictest0-21swapper/600:19:596
875448992415,9cyclictest0-21swapper/223:58:152
87544199240,24cyclictest0-21swapper/120:02:581
87544199240,24cyclictest0-21swapper/120:02:581
875436992423,1cyclictest2107-21gnome-shell23:30:590
87548199237,15cyclictest0-21swapper/600:08:156
87546799230,0cyclictest0-21swapper/420:21:584
875441992322,1cyclictest2107-21gnome-shell19:34:581
10868662230,0sleep40-21swapper/422:55:574
875489992220,1cyclictest2107-21gnome-shell19:37:587
875481992221,1cyclictest2107-21gnome-shell20:51:586
87544899226,15cyclictest0-21swapper/222:33:152
875441992222,0cyclictest0-21swapper/123:27:191
216999220,2rtkit-daemon2168-21rtkit-daemon20:01:054
216999220,2rtkit-daemon2168-21rtkit-daemon20:01:054
875489992120,1cyclictest0-21swapper/721:38:587
87547499215,15cyclictest0-21swapper/500:03:155
875448992121,0cyclictest0-21swapper/200:09:262
875448992120,1cyclictest2107-21gnome-shell00:30:592
875441992117,0cyclictest0-21swapper/122:18:321
87543699212,14cyclictest0-21swapper/022:58:150
11193102210,0sleep70-21swapper/723:23:007
875489992019,1cyclictest2107-21gnome-shell20:22:587
87548199204,15cyclictest0-21swapper/620:58:156
87548199203,16cyclictest0-21swapper/620:23:156
875481992019,1cyclictest2107-21gnome-shell23:08:596
87548199201,13cyclictest0-21swapper/622:30:006
875474992019,1cyclictest0-21swapper/522:32:595
875467992019,1cyclictest0-21swapper/421:23:404
875448992019,1cyclictest0-21swapper/222:15:172
875441992020,0cyclictest0-21swapper/120:25:581
11369672200,0sleep20-21swapper/223:36:412
10990352200,0sleep30-21swapper/323:05:343
10814022200,0sleep10-21swapper/122:52:021
10814022200,0sleep10-21swapper/122:52:021
875489991919,0cyclictest0-21swapper/700:13:327
87548199193,15cyclictest0-21swapper/621:48:156
875481991918,1cyclictest2107-21gnome-shell21:17:596
875481991918,1cyclictest2107-21gnome-shell20:33:586
875474991919,0cyclictest0-21swapper/522:23:595
87544199192,15cyclictest0-21swapper/122:38:151
216999190,1rtkit-daemon0-21swapper/421:48:081
11321942190,2sleep20-21swapper/223:33:452
9207412180,0sleep00-21swapper/020:20:140
875489991817,1cyclictest2107-21gnome-shell21:58:587
87548199182,15cyclictest1116843-21ntp_states23:20:196
875481991817,1cyclictest2107-21gnome-shell00:24:596
87548199181,16cyclictest957396-21idleruntime-cro21:15:006
875460991817,1cyclictest2107-21gnome-shell21:38:583
875460991817,1cyclictest0-21swapper/320:22:583
875460991817,1cyclictest0-21swapper/319:37:583
875436991818,0cyclictest0-21swapper/019:24:580
875489991716,1cyclictest0-21swapper/722:19:597
87548199174,12cyclictest950995-21diskmemload23:50:506
87548199171,2cyclictest912866-21smartctl20:05:226
87548199171,13cyclictest823-21earlyoom22:35:596
87548199170,0cyclictest0-21swapper/621:35:226
875467991716,1cyclictest2107-21gnome-shell21:53:584
87546799170,7cyclictest0-21swapper/423:18:154
87546099171,1cyclictest0-21swapper/320:28:153
87544199178,7cyclictest823-21earlyoom22:06:441
875489991615,1cyclictest2107-21gnome-shell20:57:587
875489991612,2cyclictest823-21earlyoom23:33:237
87548199163,12cyclictest986-21runrttasks21:31:576
87548199162,10cyclictest903428-21pmu-power19:50:236
87548199160,2cyclictest1076662-21kworker/u16:123:04:396
87548199160,1cyclictest0-21swapper/622:52:516
87548199160,1cyclictest0-21swapper/622:52:516
87548199160,15cyclictest0-21swapper/622:42:366
87548199160,0cyclictest0-21swapper/600:13:056
87547499162,9cyclictest0-21swapper/522:18:155
87547499162,2cyclictest121rcu_preempt23:01:095
87547499160,1cyclictest0-21swapper/523:53:145
875448991615,1cyclictest28-21ksoftirqd/221:58:092
875441991616,0cyclictest0-21swapper/120:55:581
875441991615,1cyclictest2107-21gnome-shell20:35:581
875441991614,1cyclictest9030072sleep119:50:201
216999160,1rtkit-daemon823-21earlyoom19:12:160
875489991514,1cyclictest0-21swapper/700:17:597
875489991514,1cyclictest0-21swapper/700:17:587
87548199151,11cyclictest1143167-21sh23:41:406
87548199150,1cyclictest950995-21diskmemload23:55:196
87548199150,1cyclictest1037229-21ssh22:15:596
87548199150,1cyclictest0-21swapper/623:35:176
87548199150,1cyclictest0-21swapper/600:32:486
875474991515,0cyclictest0-21swapper/500:36:585
875474991515,0cyclictest0-21swapper/500:07:285
875474991514,1cyclictest49-21ksoftirqd/523:36:055
875474991514,1cyclictest2107-21gnome-shell19:45:585
87547499150,8cyclictest0-21swapper/521:58:155
875460991514,1cyclictest0-21swapper/321:58:583
87546099151,10cyclictest919599-21systemd-userwor20:16:513
875448991513,1cyclictest28-21ksoftirqd/220:40:222
875436991513,1cyclictest97850irq/166-enp0s3100:09:500
216999150,1rtkit-daemon823-21earlyoom19:16:130
216999150,1rtkit-daemon2168-21rtkit-daemon22:55:455
216999150,1rtkit-daemon2168-21rtkit-daemon20:32:430
12130492150,2sleep10-21swapper/100:39:131
10564632150,3sleep10-21swapper/122:31:521
10418632150,0sleep30-21swapper/322:20:163
875489991413,1cyclictest63-21ksoftirqd/723:17:077
875489991413,1cyclictest0-21swapper/723:51:167
87548999140,14cyclictest1203338-21latency00:30:177
87548999140,14cyclictest0-21swapper/722:31:067
87548999140,14cyclictest0-21swapper/722:07:217
87548999140,14cyclictest0-21swapper/722:02:297
87548199143,10cyclictest903968-1kworker/u17:222:56:116
87548199142,1cyclictest0-21swapper/622:45:196
87548199142,10cyclictest950995-21diskmemload23:28:216
875481991412,2cyclictest0-21swapper/622:14:476
875481991412,2cyclictest0-21swapper/620:36:056
87548199141,1cyclictest950995-21diskmemload00:27:146
87548199140,2cyclictest0-21swapper/623:45:126
87548199140,1cyclictest905670-21fschecks_time19:55:156
87548199140,1cyclictest1009660-21cat21:55:146
87548199140,1cyclictest0-21swapper/622:06:126
87548199140,1cyclictest0-21swapper/600:02:396
87548199140,12cyclictest995222-21ssh21:44:286
87548199140,0cyclictest0-21swapper/623:33:306
87548199140,0cyclictest0-21swapper/621:00:236
87547499140,1cyclictest1178177-21fschecks_time00:10:135
87547499140,0cyclictest0-21swapper/522:43:045
87546799147,6cyclictest890-21gmain22:52:244
87546799147,6cyclictest890-21gmain22:52:244
87546799145,8cyclictest2166-21packagekitd00:20:174
87546799142,3cyclictest121rcu_preempt00:30:304
87546799141,9cyclictest2123-21JS17:37:034
875467991414,0cyclictest0-21swapper/421:29:124
875467991414,0cyclictest0-21swapper/421:29:124
87546099142,7cyclictest823-21earlyoom21:26:383
87546099142,7cyclictest823-21earlyoom21:26:383
875460991413,1cyclictest2107-21gnome-shell22:19:593
875448991412,1cyclictest28-21ksoftirqd/220:45:262
875448991412,1cyclictest0-21swapper/221:16:262
875436991413,1cyclictest897149-21awk19:40:210
875436991412,1cyclictest97850irq/166-enp0s3100:25:050
216999140,0rtkit-daemon0-21swapper/522:04:361
216999140,0rtkit-daemon0-21swapper/500:02:081
9565522130,1sleep40-21swapper/421:13:534
87548999132,10cyclictest1156664-21kworker/7:000:05:077
875489991313,0cyclictest0-21swapper/723:40:027
875489991313,0cyclictest0-21swapper/723:02:297
875489991313,0cyclictest0-21swapper/722:59:437
875489991313,0cyclictest0-21swapper/700:21:117
875489991312,1cyclictest0-21swapper/721:12:347
875489991311,1cyclictest2107-21gnome-shell22:48:597
87548999130,13cyclictest1205586-21kworker/7:022:13:427
87548999130,13cyclictest0-21swapper/723:05:157
87548999130,13cyclictest0-21swapper/721:53:227
87548999130,0cyclictest0-21swapper/723:58:547
87548999130,0cyclictest0-21swapper/723:47:027
87548999130,0cyclictest0-21swapper/721:40:127
87548199132,10cyclictest885368-21sshd19:21:206
875481991310,3cyclictest0-21swapper/621:50:246
87548199130,0cyclictest0-21swapper/620:42:066
875474991313,0cyclictest0-21swapper/521:32:495
875474991313,0cyclictest0-21swapper/500:27:595
87547499130,13cyclictest0-21swapper/522:35:265
87547499130,13cyclictest0-21swapper/522:01:565
87547499130,0cyclictest0-21swapper/523:45:115
875467991313,0cyclictest0-21swapper/422:36:314
875467991313,0cyclictest0-21swapper/421:38:084
875467991313,0cyclictest0-21swapper/421:00:154
875467991312,1cyclictest42-21ksoftirqd/423:28:244
875467991312,1cyclictest0-21swapper/400:17:304
875467991312,1cyclictest0-21swapper/400:17:304
875467991310,3cyclictest2297-21pool-gsd-smartc00:00:234
87546799130,1cyclictest0-21swapper/422:26:074
87546799130,13cyclictest0-21swapper/423:55:134
87546799130,13cyclictest0-21swapper/422:33:454
87546799130,0cyclictest0-21swapper/422:44:104
87546099135,7cyclictest1051092-21kworker/u16:323:15:443
87546099132,6cyclictest878558-21munin-node22:55:413
875460991312,1cyclictest0-21swapper/320:57:583
87544899131,8cyclictest878558-21munin-node22:55:432
875448991313,0cyclictest0-21swapper/221:12:582
875448991312,1cyclictest0-21swapper/223:23:252
87544899130,13cyclictest0-21swapper/221:33:402
87544899130,13cyclictest0-21swapper/221:24:432
87544899130,0cyclictest0-21swapper/223:47:492
87544899130,0cyclictest0-21swapper/200:26:502
87544199134,8cyclictest845-21rngd22:42:071
87544199130,13cyclictest0-21swapper/122:28:571
87544199130,13cyclictest0-21swapper/121:17:241
87544199130,0cyclictest0-21swapper/123:20:201
87544199130,0cyclictest0-21swapper/123:01:381
87544199130,0cyclictest0-21swapper/121:41:381
87544199130,0cyclictest0-21swapper/121:28:271
87544199130,0cyclictest0-21swapper/121:28:271
87543699133,8cyclictest0-21swapper/022:00:140
875436991312,1cyclictest97850irq/166-enp0s3100:32:170
875436991312,1cyclictest0-21swapper/021:58:530
875436991312,1cyclictest0-21swapper/000:20:020
875436991311,1cyclictest97850irq/166-enp0s3121:36:480
87543699130,2cyclictest0-21swapper/023:24:060
87543699130,13cyclictest0-21swapper/023:09:080
87543699130,13cyclictest0-21swapper/023:00:510
87543699130,13cyclictest0-21swapper/022:20:310
87543699130,12cyclictest0-21swapper/020:54:590
87543699130,0cyclictest0-21swapper/000:36:080
216999130,1rtkit-daemon2168-21rtkit-daemon23:56:291
10312472130,0sleep50-21swapper/522:11:305
9615132120,3sleep30-21swapper/321:16:573
87548999124,6cyclictest11042992sleep723:10:197
875489991212,0cyclictest0-21swapper/723:28:107
875489991212,0cyclictest0-21swapper/721:49:097
875489991212,0cyclictest0-21swapper/721:28:307
875489991212,0cyclictest0-21swapper/721:28:307
875489991212,0cyclictest0-21swapper/720:05:247
87548199121,4cyclictest950995-21diskmemload21:22:316
87548199121,1cyclictest881758-21systemd-userwor19:15:236
87548199120,1cyclictest890133-21perl19:30:156
87548199120,1cyclictest0-21swapper/620:10:196
875474991212,0cyclictest0-21swapper/523:31:125
875474991212,0cyclictest0-21swapper/523:12:595
875474991212,0cyclictest0-21swapper/521:54:565
87547499121,1cyclictest121rcu_preempt23:29:145
87547499121,1cyclictest121rcu_preempt21:45:055
87547499120,0cyclictest0-21swapper/519:35:545
875467991212,0cyclictest0-21swapper/423:32:174
875467991212,0cyclictest0-21swapper/422:04:294
875467991212,0cyclictest0-21swapper/400:12:374
875467991211,1cyclictest0-21swapper/423:52:274
875467991211,1cyclictest0-21swapper/423:07:544
87546799120,12cyclictest0-21swapper/421:47:054
87546799120,11cyclictest0-21swapper/419:15:244
87546099123,8cyclictest901-21NetworkManager21:20:183
87546099122,1cyclictest121rcu_preempt23:36:183
875460991211,1cyclictest2107-21gnome-shell00:17:593
875460991211,1cyclictest2107-21gnome-shell00:17:593
87546099121,10cyclictest1068084-21taskset22:40:433
87546099120,9cyclictest937-21lldpd21:31:363
87546099120,1cyclictest0-21swapper/323:51:133
87546099120,12cyclictest0-21swapper/323:14:573
87544899123,9cyclictest845-21rngd00:23:332
875448991212,0cyclictest0-21swapper/222:45:132
875448991212,0cyclictest0-21swapper/222:22:562
875448991212,0cyclictest0-21swapper/222:04:042
875448991211,1cyclictest2107-21gnome-shell23:54:592
875448991211,1cyclictest1124247-21ssh23:26:112
875448991210,1cyclictest0-21swapper/223:10:152
87544899120,0cyclictest0-21swapper/200:17:052
87544899120,0cyclictest0-21swapper/200:17:042
875441991212,0cyclictest0-21swapper/122:56:061
875441991212,0cyclictest0-21swapper/121:31:131
875441991211,1cyclictest2107-21gnome-shell00:05:591
875441991210,1cyclictest957104-21ssh21:14:381
875436991212,0cyclictest0-21swapper/022:41:200
875436991212,0cyclictest0-21swapper/000:01:590
875436991211,1cyclictest0-21swapper/021:24:250
875436991211,1cyclictest0-21swapper/019:55:580
87543699120,12cyclictest0-21swapper/022:28:100
87543699120,11cyclictest0-21swapper/023:44:090
216999120,0rtkit-daemon0-21swapper/523:40:511
216999120,0rtkit-daemon0-21swapper/021:48:020
12138752120,0sleep20-21swapper/200:40:012
10816342120,1sleep50-21swapper/522:52:235
10816342120,1sleep50-21swapper/522:52:235
87548999113,6cyclictest937-21lldpd20:10:427
87548999111,10cyclictest1205586-21kworker/7:022:21:237
875489991111,0cyclictest0-21swapper/719:17:367
875489991110,1cyclictest2107-21gnome-shell19:41:587
875489991110,1cyclictest0-21swapper/722:28:207
875489991110,1cyclictest0-21swapper/721:06:237
875489991110,1cyclictest0-21swapper/720:42:587
87548999110,11cyclictest0-21swapper/720:32:147
87548999110,11cyclictest0-21swapper/720:15:547
87548999110,11cyclictest0-21swapper/719:35:007
87548999110,11cyclictest0-21swapper/719:23:377
875481991111,0cyclictest0-21swapper/619:40:096
87548199110,2cyclictest918837-21netstat20:15:206
87548199110,1cyclictest923760-21cstates20:25:156
87547499111,3cyclictest121rcu_preempt23:59:145
875474991111,0cyclictest0-21swapper/519:57:145
875474991110,1cyclictest49-21ksoftirqd/521:10:195
87547499110,0cyclictest0-21swapper/520:15:545
87547499110,0cyclictest0-21swapper/519:42:345
87546799111,1cyclictest121rcu_preempt23:37:534
875467991111,0cyclictest0-21swapper/400:29:224
875467991110,1cyclictest42-21ksoftirqd/400:36:174
875467991110,1cyclictest0-21swapper/420:56:504
875467991110,1cyclictest0-21swapper/419:23:404
87546799110,11cyclictest0-21swapper/420:49:314
87546799110,11cyclictest0-21swapper/420:16:314
87546099117,4cyclictest10493972sleep322:25:383
875460991111,0cyclictest0-21swapper/323:40:583
875460991111,0cyclictest0-21swapper/322:12:503
875460991111,0cyclictest0-21swapper/300:40:003
875460991111,0cyclictest0-21swapper/300:26:503
875460991110,1cyclictest0-21swapper/300:20:393
87546099110,1cyclictest0-21swapper/320:00:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional