You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 09:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot6.osadl.org (updated Mon Dec 01, 2025 00:46:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17018821010,1sleep10-21swapper/119:05:151
216999950,49rtkit-daemon0-21swapper/019:08:020
17189428944,13sleep40-21swapper/419:05:434
2882152850,0sleep00-21swapper/021:40:230
17204928442,12sleep60-21swapper/619:07:546
172425998316,38cyclictest0-21swapper/621:48:146
17204628342,34sleep30-21swapper/319:07:513
2699462820,0sleep40-21swapper/421:25:374
172425998015,35cyclictest0-21swapper/621:33:146
4596242780,0sleep10-21swapper/123:57:211
172425997814,35cyclictest0-21swapper/600:13:146
3048892750,0sleep00-21swapper/021:55:050
4229982740,0sleep10-21swapper/123:28:461
3858842720,0sleep50-21swapper/522:59:345
17191427246,13sleep50-21swapper/519:06:015
17203626942,14sleep20-21swapper/219:07:432
17180426942,13sleep70-21swapper/719:05:307
4716472670,0sleep40-21swapper/400:09:594
17243299496,21cyclictest0-21swapper/723:28:147
172432994710,35cyclictest133337-21kworker/7:020:58:157
172432994710,35cyclictest133337-21kworker/7:020:58:147
172432993916,12cyclictest0-21swapper/720:03:147
172432993816,22cyclictest0-21swapper/723:08:147
172432993615,10cyclictest0-21swapper/722:43:147
172403993510,24cyclictest0-21swapper/322:27:583
172425993410,24cyclictest0-21swapper/619:34:586
172403993411,0cyclictest0-21swapper/323:24:583
172379993411,0cyclictest0-21swapper/021:13:580
172379993410,24cyclictest0-21swapper/022:26:580
17243299339,24cyclictest0-21swapper/719:54:597
17240399339,24cyclictest0-21swapper/300:28:583
172425993215,16cyclictest0-21swapper/622:13:146
17239699328,24cyclictest0-21swapper/221:14:582
172432993115,15cyclictest0-21swapper/700:03:147
17237999318,0cyclictest0-21swapper/022:58:580
172432993030,0cyclictest0-21swapper/723:57:567
172432993014,15cyclictest0-21swapper/721:28:147
172432993014,11cyclictest0-21swapper/723:18:147
172432993010,14cyclictest0-21swapper/721:18:157
172425993014,15cyclictest0-21swapper/623:38:146
172425993014,15cyclictest0-21swapper/600:33:146
17239699305,24cyclictest0-21swapper/221:48:582
172432992913,15cyclictest0-21swapper/720:18:157
172432992913,15cyclictest0-21swapper/719:13:147
17240399296,0cyclictest0-21swapper/319:43:583
17239699295,24cyclictest0-21swapper/219:37:592
17242599285,0cyclictest0-21swapper/620:31:586
17243299278,15cyclictest0-21swapper/721:08:147
17237999273,24cyclictest0-21swapper/020:32:580
172379992711,15cyclictest0-21swapper/023:23:140
17243299269,16cyclictest0-21swapper/719:23:147
172432992626,0cyclictest0-21swapper/700:26:437
172425992610,15cyclictest0-21swapper/620:08:156
172425992610,15cyclictest0-21swapper/619:43:146
17239699261,24cyclictest0-21swapper/222:11:582
4425752250,0sleep5481rcuc/523:44:525
17242599259,15cyclictest0-21swapper/619:58:146
17242599252,0cyclictest0-21swapper/620:18:586
17242599251,24cyclictest0-21swapper/622:19:586
17239699252,0cyclictest0-21swapper/222:44:582
4949442240,0sleep40-21swapper/400:27:284
17243299240,24cyclictest0-21swapper/720:46:597
172425992423,1cyclictest2107-21gnome-shell20:22:586
17242599240,24cyclictest0-21swapper/620:54:586
17242599240,24cyclictest0-21swapper/619:39:586
17241199248,15cyclictest0-21swapper/422:33:144
172396992423,1cyclictest2107-21gnome-shell19:19:582
172396992422,1cyclictest2107-21gnome-shell19:57:592
17239699240,24cyclictest0-21swapper/223:47:582
17239699240,24cyclictest0-21swapper/223:47:582
172379992423,1cyclictest2107-21gnome-shell19:56:580
4833872230,0sleep00-21swapper/000:18:510
4472002230,1sleep549-21ksoftirqd/523:47:325
4472002230,1sleep549-21ksoftirqd/523:47:325
172379992322,1cyclictest2107-21gnome-shell22:34:580
4780912220,0sleep20-21swapper/200:15:012
3022562220,0sleep00-21swapper/021:51:520
17243299228,13cyclictest0-21swapper/721:38:147
172425992221,1cyclictest2107-21gnome-shell22:39:586
172425992220,1cyclictest2107-21gnome-shell22:48:586
17241199226,15cyclictest0-21swapper/421:23:144
17239699226,12cyclictest0-21swapper/222:48:142
17237999226,15cyclictest0-21swapper/021:03:140
17243299215,1cyclictest0-21swapper/719:33:147
172411992121,0cyclictest0-21swapper/421:16:484
172403992120,1cyclictest2107-21gnome-shell23:56:583
172403992120,1cyclictest0-21swapper/300:37:583
172403992117,2cyclictest263617-21systemd-userwor21:25:093
17239699217,14cyclictest0-21swapper/222:23:152
17239699217,14cyclictest0-21swapper/222:23:142
172396992120,1cyclictest0-21swapper/200:28:142
172379992121,0cyclictest2107-21gnome-shell20:17:580
4394582200,0sleep40-21swapper/423:40:264
3370302200,0sleep00-21swapper/022:20:130
3370302200,0sleep00-21swapper/022:20:120
2968132200,0sleep40-21swapper/421:48:044
172417992019,1cyclictest0-21swapper/523:25:585
172403992020,0cyclictest0-21swapper/321:44:593
172403992019,1cyclictest2107-21gnome-shell23:35:583
17239699204,15cyclictest0-21swapper/220:23:152
172396992020,0cyclictest0-21swapper/220:47:582
172396992013,7cyclictest0-21swapper/223:33:152
172396992012,8cyclictest0-21swapper/221:53:152
172396992012,8cyclictest0-21swapper/200:38:142
2243952190,0sleep10-21swapper/120:30:151
172432991919,0cyclictest0-21swapper/720:11:587
172425991913,5cyclictest986-21runrttasks23:28:066
172411991910,7cyclictest823-21earlyoom23:16:364
17239699193,15cyclictest0-21swapper/222:03:142
172396991918,0cyclictest0-21swapper/220:43:582
172384991917,1cyclictest2107-21gnome-shell00:01:591
17237999190,16cyclictest0-21swapper/020:05:140
17243299182,8cyclictest0-21swapper/721:30:527
17242599182,15cyclictest0-21swapper/623:48:146
17242599182,15cyclictest0-21swapper/623:48:146
172425991817,1cyclictest2107-21gnome-shell21:19:586
172411991818,0cyclictest0-21swapper/420:01:584
172403991817,1cyclictest2107-21gnome-shell22:35:583
172379991817,1cyclictest2107-21gnome-shell20:13:580
4492162170,0sleep10-21swapper/123:50:011
4492162170,0sleep10-21swapper/123:50:001
216999170,2rtkit-daemon823-21earlyoom00:18:044
172432991716,1cyclictest63-21ksoftirqd/700:20:247
172432991716,1cyclictest0-21swapper/723:53:147
172432991716,1cyclictest0-21swapper/723:53:147
17242599171,1cyclictest0-21swapper/623:13:146
172417991716,1cyclictest0-21swapper/500:01:585
172403991715,2cyclictest467756-21kworker/3:022:18:113
17239699172,14cyclictest0-21swapper/220:53:142
172384991716,1cyclictest0-21swapper/123:23:591
172379991716,1cyclictest97850irq/166-enp0s3123:00:000
172379991710,7cyclictest855-21in:imjournal22:39:330
2595812160,0sleep00-21swapper/021:18:440
216999160,1rtkit-daemon2168-21rtkit-daemon22:45:160
216999160,1rtkit-daemon2168-21rtkit-daemon20:54:040
216999160,1rtkit-daemon0-21swapper/421:53:144
216999160,0rtkit-daemon0-21swapper/022:13:464
17243299162,11cyclictest901-21NetworkManager22:06:587
17243299160,4cyclictest0-21swapper/719:48:147
172417991615,1cyclictest2107-21gnome-shell23:23:585
172417991615,1cyclictest1-21systemd21:57:595
17241799161,3cyclictest121rcu_preempt00:32:555
172417991612,2cyclictest823-21earlyoom22:10:245
17241199166,8cyclictest2166-21packagekitd23:23:054
172411991615,1cyclictest42-21ksoftirqd/423:13:534
172403991616,0cyclictest0-21swapper/323:12:583
172403991616,0cyclictest0-21swapper/300:33:083
172403991615,1cyclictest35-21ksoftirqd/321:11:353
172396991616,0cyclictest0-21swapper/220:58:592
172396991616,0cyclictest0-21swapper/220:58:592
172396991615,1cyclictest2107-21gnome-shell19:49:582
172396991615,1cyclictest2107-21gnome-shell19:30:592
2656142150,1sleep60-21swapper/621:23:246
216999150,1rtkit-daemon2168-21rtkit-daemon22:46:064
216999150,1rtkit-daemon2168-21rtkit-daemon19:48:004
172432991513,2cyclictest2110-21gmain22:17:357
17242599159,5cyclictest844-21nscd00:26:236
172425991514,1cyclictest0-21swapper/623:09:016
172425991514,1cyclictest0-21swapper/621:25:176
17241799151,1cyclictest121rcu_preempt23:17:595
172411991515,0cyclictest0-21swapper/421:06:584
172403991515,0cyclictest0-21swapper/323:40:593
172403991515,0cyclictest0-21swapper/320:39:593
17239699150,15cyclictest0-21swapper/223:39:582
17239699150,15cyclictest0-21swapper/222:39:582
17238499157,7cyclictest844-21nscd23:31:431
172384991514,1cyclictest21-21ksoftirqd/120:40:451
172384991514,1cyclictest0-21swapper/120:38:581
172384991513,1cyclictest0-21swapper/122:01:461
17238499150,14cyclictest377100-21sh22:51:031
17237999154,7cyclictest823-21earlyoom21:38:490
172379991514,1cyclictest97850irq/166-enp0s3123:31:040
17237999151,14cyclictest175418-21awk19:15:010
2955762140,1sleep30-21swapper/321:46:193
2473412140,1sleep228-21ksoftirqd/221:05:242
216999140,1rtkit-daemon0-21swapper/421:25:160
172432991413,1cyclictest0-21swapper/719:35:207
172425991413,1cyclictest0-21swapper/600:18:556
17242599141,1cyclictest0-21swapper/622:20:146
17242599141,1cyclictest0-21swapper/622:20:146
17242599140,1cyclictest0-21swapper/600:01:236
172417991413,1cyclictest2107-21gnome-shell20:38:585
17241799141,13cyclictest0-21swapper/522:32:165
172417991411,2cyclictest459798-21ssh23:57:365
17241799140,1cyclictest0-21swapper/523:35:215
17241799140,1cyclictest0-21swapper/523:09:515
17241799140,1cyclictest0-21swapper/521:29:505
17241799140,1cyclictest0-21swapper/500:07:435
17241799140,13cyclictest0-21swapper/522:35:055
172411991413,1cyclictest0-21swapper/422:18:074
17241199140,14cyclictest0-21swapper/419:43:044
17240399142,9cyclictest235390-21systemd-userwor20:52:573
172403991414,0cyclictest0-21swapper/319:52:483
172403991413,1cyclictest2107-21gnome-shell20:59:583
172403991413,1cyclictest2107-21gnome-shell20:59:583
17239699140,1cyclictest0-21swapper/223:42:412
17239699140,1cyclictest0-21swapper/200:16:102
17238499142,3cyclictest121rcu_preempt22:10:221
17238499140,1cyclictest0-21swapper/121:53:291
17238499140,1cyclictest0-21swapper/121:37:331
17238499140,1cyclictest0-21swapper/100:16:051
17238499140,14cyclictest0-21swapper/122:15:261
17238499140,14cyclictest0-21swapper/121:34:471
17238499140,14cyclictest0-21swapper/121:25:011
172379991411,1cyclictest97850irq/166-enp0s3123:14:200
5016952130,1sleep00-21swapper/000:33:100
3520612130,1sleep60-21swapper/622:31:096
216999130,1rtkit-daemon420564-21/usr/sbin/munin23:25:244
216999130,1rtkit-daemon2297-21pool-gsd-smartc19:51:094
17243299139,3cyclictest0-21swapper/722:22:547
17243299139,3cyclictest0-21swapper/722:22:537
172432991312,1cyclictest0-21swapper/723:31:457
17243299130,13cyclictest0-21swapper/723:36:387
17242599135,1cyclictest1392-21systemd-userdbd00:06:086
172425991312,1cyclictest0-21swapper/622:25:466
172425991311,1cyclictest2107-21gnome-shell21:14:586
172417991312,1cyclictest0-21swapper/521:15:315
17241799130,1cyclictest0-21swapper/521:45:365
17241799130,13cyclictest247914-21diskmemload21:39:255
17241799130,13cyclictest0-21swapper/521:34:485
17241799130,13cyclictest0-21swapper/521:23:395
17241799130,13cyclictest0-21swapper/500:23:105
17241799130,10cyclictest316679-21systemd-userwor22:08:135
17241199139,1cyclictest823-21earlyoom23:50:514
17241199139,1cyclictest823-21earlyoom23:50:514
17241199133,8cyclictest175492-21munin-node23:30:174
172411991312,1cyclictest42-21ksoftirqd/400:10:464
172411991312,1cyclictest0-21swapper/423:38:154
172411991312,1cyclictest0-21swapper/423:05:344
17241199130,13cyclictest0-21swapper/422:58:354
17241199130,13cyclictest0-21swapper/419:25:244
17241199130,13cyclictest0-21swapper/419:25:244
17241199130,0cyclictest0-21swapper/422:37:364
17240399133,8cyclictest829-21irqbalance22:31:483
172403991313,0cyclictest0-21swapper/323:03:033
172403991312,1cyclictest2107-21gnome-shell22:23:583
172403991312,1cyclictest2107-21gnome-shell22:23:583
17240399130,13cyclictest0-21swapper/323:07:563
17240399130,13cyclictest0-21swapper/322:11:203
17240399130,13cyclictest0-21swapper/300:23:533
17240399130,13cyclictest0-21swapper/300:13:573
17239699136,6cyclictest28-21ksoftirqd/223:53:272
17239699136,6cyclictest28-21ksoftirqd/223:53:262
172396991313,0cyclictest0-21swapper/222:17:482
172396991312,1cyclictest0-21swapper/221:15:122
17239699130,13cyclictest0-21swapper/223:23:202
17239699130,13cyclictest0-21swapper/221:24:472
17239699130,13cyclictest0-21swapper/200:05:362
172384991313,0cyclictest0-21swapper/123:51:321
172384991313,0cyclictest0-21swapper/123:51:321
172384991313,0cyclictest0-21swapper/123:42:351
172384991313,0cyclictest0-21swapper/100:38:031
172384991312,1cyclictest0-21swapper/121:12:021
17238499130,1cyclictest0-21swapper/121:57:181
17238499130,13cyclictest0-21swapper/123:39:491
17238499130,13cyclictest0-21swapper/123:01:371
17238499130,13cyclictest0-21swapper/122:55:161
17238499130,13cyclictest0-21swapper/100:08:171
172379991312,1cyclictest10-21ksoftirqd/000:22:100
17237999130,13cyclictest0-21swapper/022:19:150
17237999130,13cyclictest0-21swapper/022:05:360
17237999130,13cyclictest0-21swapper/000:09:490
5081652120,0sleep50-21swapper/500:38:275
4502902120,0sleep00-21swapper/023:50:160
4502902120,0sleep00-21swapper/023:50:150
3416262120,1sleep50-21swapper/522:24:105
3416262120,1sleep50-21swapper/522:24:105
2639762120,1sleep30-21swapper/321:21:043
216999120,1rtkit-daemon2297-21pool-gsd-smartc21:30:410
216999120,1rtkit-daemon2168-21rtkit-daemon23:01:464
216999120,1rtkit-daemon2131-21gmain23:29:310
216999120,0rtkit-daemon0-21swapper/021:48:090
216999120,0rtkit-daemon0-21swapper/021:39:404
216999120,0rtkit-daemon0-21swapper/020:15:554
17243299122,10cyclictest295028-21kworker/7:000:06:467
17243299120,12cyclictest0-21swapper/721:41:317
17243299120,0cyclictest0-21swapper/723:49:017
17243299120,0cyclictest0-21swapper/723:49:007
17243299120,0cyclictest0-21swapper/723:12:347
17242599126,5cyclictest424473-21telnet23:30:116
17242599126,3cyclictest0-21swapper/623:02:016
172425991212,0cyclictest0-21swapper/623:50:296
172425991212,0cyclictest0-21swapper/623:50:296
172425991212,0cyclictest0-21swapper/620:55:216
172425991212,0cyclictest0-21swapper/620:55:216
172425991211,1cyclictest0-21swapper/620:25:166
17242599120,12cyclictest0-21swapper/621:44:196
17241799122,7cyclictest587-21systemd-journal23:35:015
172417991212,0cyclictest0-21swapper/522:04:085
17241799121,1cyclictest0-21swapper/519:10:575
172417991211,1cyclictest0-21swapper/522:29:305
17241799120,7cyclictest0-21swapper/523:11:435
17241799120,1cyclictest0-21swapper/523:54:345
17241799120,1cyclictest0-21swapper/523:54:335
17241799120,1cyclictest0-21swapper/520:07:375
17241799120,1cyclictest0-21swapper/519:41:225
17241799120,1cyclictest0-21swapper/519:30:495
17241799120,1cyclictest0-21swapper/519:20:525
17241799120,12cyclictest0-21swapper/522:42:405
17241199122,6cyclictest823-21earlyoom22:41:054
17241199122,6cyclictest442542-21systemd-userwor23:46:294
17241199122,6cyclictest442542-21systemd-userwor23:46:284
172411991212,0cyclictest0-21swapper/422:07:514
172411991212,0cyclictest0-21swapper/421:55:294
172411991212,0cyclictest0-21swapper/421:40:124
17241199120,0cyclictest0-21swapper/422:54:224
17241199120,0cyclictest0-21swapper/420:35:104
17241199120,0cyclictest0-21swapper/420:29:094
17240399128,2cyclictest823-21earlyoom22:07:083
17240399123,5cyclictest277-1kworker/3:1H00:00:083
172403991212,0cyclictest0-21swapper/322:55:153
172403991212,0cyclictest0-21swapper/322:44:023
172403991212,0cyclictest0-21swapper/321:18:493
172403991211,1cyclictest467756-21kworker/3:019:47:283
17240399120,12cyclictest0-21swapper/320:09:243
17239699124,5cyclictest901-21NetworkManager22:57:142
172396991212,0cyclictest0-21swapper/223:09:302
172396991212,0cyclictest0-21swapper/222:29:402
172396991212,0cyclictest0-21swapper/221:42:012
172396991212,0cyclictest0-21swapper/221:35:512
172396991211,1cyclictest28-21ksoftirqd/223:56:212
172396991211,1cyclictest28-21ksoftirqd/223:18:132
17239699120,1cyclictest0-21swapper/219:50:192
17239699120,0cyclictest0-21swapper/222:32:262
17239699120,0cyclictest0-21swapper/221:30:202
17238499122,9cyclictest175492-21munin-node00:13:171
17238499121,6cyclictest587-21systemd-journal19:45:001
172384991212,0cyclictest0-21swapper/123:18:211
172384991212,0cyclictest0-21swapper/122:30:041
172384991212,0cyclictest0-21swapper/121:43:041
172384991212,0cyclictest0-21swapper/100:23:531
17238499120,1cyclictest0-21swapper/120:48:081
17238499120,1cyclictest0-21swapper/119:54:331
17238499120,1cyclictest0-21swapper/119:35:061
172379991212,0cyclictest0-21swapper/022:50:380
17237999120,1cyclictest0-21swapper/019:41:230
17237999120,0cyclictest0-21swapper/022:40:540
2964652110,1sleep70-21swapper/721:47:377
216999110,0rtkit-daemon0-21swapper/423:55:400
216999110,0rtkit-daemon0-21swapper/423:07:240
216999110,0rtkit-daemon0-21swapper/022:02:484
216999110,0rtkit-daemon0-21swapper/021:11:084
216999110,0rtkit-daemon0-21swapper/020:57:124
216999110,0rtkit-daemon0-21swapper/020:57:124
216999110,0rtkit-daemon0-21swapper/019:20:064
17243299115,5cyclictest844-21nscd23:20:157
172432991111,0cyclictest0-21swapper/723:42:497
172432991111,0cyclictest0-21swapper/722:59:257
172432991111,0cyclictest0-21swapper/722:52:257
172432991111,0cyclictest0-21swapper/700:36:387
17243299110,11cyclictest0-21swapper/719:16:087
17243299110,0cyclictest0-21swapper/720:24:557
17243299110,0cyclictest0-21swapper/720:05:447
17242599118,2cyclictest855-21in:imjournal22:43:386
17242599116,4cyclictest0-21swapper/622:00:206
17242599114,4cyclictest456083-21cpuspeed_turbos23:55:136
17242599113,6cyclictest901-21NetworkManager21:53:006
17242599113,5cyclictest0-21swapper/621:35:126
172425991111,0cyclictest0-21swapper/619:26:586
172425991111,0cyclictest0-21swapper/619:26:586
17242599110,11cyclictest0-21swapper/623:22:416
17242599110,11cyclictest0-21swapper/622:54:336
17242599110,0cyclictest0-21swapper/622:57:196
17242599110,0cyclictest0-21swapper/622:06:446
172417991111,0cyclictest0-21swapper/523:04:195
172417991111,0cyclictest0-21swapper/522:15:025
172417991111,0cyclictest0-21swapper/521:51:085
172417991111,0cyclictest0-21swapper/520:19:055
172417991111,0cyclictest0-21swapper/519:59:555
172417991111,0cyclictest0-21swapper/500:25:175
172417991111,0cyclictest0-21swapper/500:11:565
17241799110,1cyclictest0-21swapper/521:06:445
17241799110,11cyclictest0-21swapper/520:53:345
17241799110,11cyclictest0-21swapper/520:44:575
17241799110,11cyclictest0-21swapper/520:30:585
17241799110,0cyclictest0-21swapper/519:54:325
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional