You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 23:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Wed Nov 19, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8582502990,2sleep30-21swapper/310:05:013
10504532290,1sleep10-21swapper/111:55:321
613351992721,2cyclictest170550irq/121-eno112:10:381
613350992615,6cyclictest0-21swapper/012:00:000
613351992522,2cyclictest677282-21gdbus08:00:011
613351992519,2cyclictest170550irq/121-eno111:20:391
613351992418,5cyclictest1629-21avahi-daemon10:45:011
613351992416,3cyclictest2035-21sshd11:14:521
613351992313,3cyclictest1093721-21cpuspeed_turbos12:20:341
613351992310,6cyclictest0-21swapper/111:15:411
613351992310,3cyclictest0-21swapper/111:10:001
613350992313,5cyclictest0-21swapper/009:25:020
61335099230,18cyclictest989814-21df11:20:340
61335199229,3cyclictest0-21swapper/109:45:021
613351992219,2cyclictest1023389-21dump-pmu-power11:40:011
613351992211,6cyclictest778898-21sshd09:18:571
613351992211,6cyclictest0-21swapper/110:30:331
613350992213,4cyclictest0-21swapper/009:10:330
613350992211,6cyclictest0-21swapper/012:40:010
613350992211,6cyclictest0-21swapper/012:05:000
613352992110,4cyclictest0-21swapper/209:10:432
61335199215,4cyclictest0-21swapper/109:45:311
613351992117,3cyclictest667883-21kthreadcore07:50:371
613351992114,3cyclictest872843-21timerwakeupswit10:10:461
613351992112,4cyclictest0-21swapper/110:55:381
613351992110,2cyclictest170550irq/121-eno110:45:421
613352992018,1cyclictest0-21swapper/209:20:022
613351992017,2cyclictest849532-21sh10:00:001
613351992017,2cyclictest755499-21switchtime09:00:451
613351992017,2cyclictest647876-21sed07:35:381
613351992017,2cyclictest1034059-21kthreadcore11:45:381
613351992017,2cyclictest1034059-21kthreadcore11:45:381
613351992010,3cyclictest0-21swapper/110:05:011
61335099209,5cyclictest0-21swapper/012:30:300
61335099209,4cyclictest806941-21cpuspeed09:35:320
61335099204,7cyclictest820175-21cat09:40:410
613350992017,2cyclictest957892-21kthreadcore11:00:390
613350992017,2cyclictest957892-21kthreadcore11:00:390
613350992017,2cyclictest1704-21rs:main0
613350992017,2cyclictest1700-21systemd-logind10:45:010
613352991916,1cyclictest0-21swapper/212:15:012
61335199198,3cyclictest0-21swapper/110:40:011
613351991916,2cyclictest945193-21munin-plugin-st10:55:011
613351991916,2cyclictest840915-21latency_hist09:55:011
613351991916,2cyclictest790209-21irqrtprio09:25:361
613351991916,2cyclictest747125-21tr08:55:391
613351991916,2cyclictest1124099-21kthreadcore12:35:401
613351991916,2cyclictest1026783-21kthreadcore11:40:381
61335099198,3cyclictest1032087-21kworker/u16:2-events_unbound11:48:180
61335099198,3cyclictest1032087-21kworker/u16:2-events_unbound11:48:180
61335099197,4cyclictest762253-21diskmemload11:07:080
61335099196,5cyclictest881513-21grep10:15:430
61335099196,5cyclictest881513-21grep10:15:430
61335099193,2cyclictest0-21swapper/011:51:150
613350991916,2cyclictest667883-21kthreadcore07:50:380
613350991912,6cyclictest613348-21cyclictest10:30:280
613350991911,4cyclictest0-21swapper/011:45:000
613350991910,4cyclictest0-21swapper/008:20:000
302487291190,2phc2sys0-21swapper/310:20:493
613352991816,1cyclictest0-21swapper/207:15:022
613352991815,1cyclictest0-21swapper/212:20:342
613352991815,1cyclictest0-21swapper/210:50:002
613352991815,1cyclictest0-21swapper/207:40:012
613351991815,2cyclictest858968-21aten_repower_vo10:05:311
613351991815,2cyclictest762357-21systemd-run09:10:011
613351991815,2cyclictest709913-21kthreadcore08:25:361
613351991815,2cyclictest684335-21gltestperf08:05:341
613351991815,2cyclictest661787-21kthreadcore07:45:371
613351991815,2cyclictest646271-21apt-key07:35:011
613351991815,2cyclictest1087866-21kthreadcore12:15:381
613351991815,2cyclictest1000818-21kthreadcore11:25:381
613351991814,3cyclictest807409-21gltestperf09:35:341
613351991814,3cyclictest783225-21kthreadcore09:20:401
613351991814,3cyclictest718144-21kthreadcore08:30:401
613351991814,2cyclictest619486-21munin-run07:15:011
613351991813,4cyclictest1009406-21kthreadcore11:30:371
613351991812,4cyclictest894155-21fschecks_time10:25:361
613351991810,3cyclictest0-21swapper/111:02:521
613351991810,3cyclictest0-21swapper/111:02:521
61335099189,4cyclictest0-21swapper/012:25:020
61335099188,5cyclictest885233-21cstates10:20:320
61335099186,6cyclictest0-21swapper/010:00:290
61335099184,6cyclictest0-21swapper/009:50:400
613350991815,2cyclictest677176-21apt-key08:00:010
613350991815,2cyclictest664037-21mailstats07:45:410
613350991815,2cyclictest658751-21kworker/u16:3-writeback11:40:020
613350991815,2cyclictest639975-21cut07:30:010
613350991815,2cyclictest619800-21head07:15:020
61335099181,2cyclictest1803-21gdbus09:20:010
613350991811,6cyclictest980648-21tail11:15:310
613350991811,6cyclictest928410-21aten_repower_vo10:45:300
613350991810,7cyclictest1008539-21kthreadcore11:30:360
61335099180,5cyclictest896210-21tr10:25:400
302487291180,3phc2sys0-21swapper/308:35:013
302487291180,2phc2sys0-21swapper/311:04:183
302487291180,2phc2sys0-21swapper/311:04:183
8394862170,2sleep20-21swapper/209:52:452
613352991715,1cyclictest0-21swapper/210:05:012
613352991715,1cyclictest0-21swapper/209:50:022
613352991714,1cyclictest0-21swapper/212:00:402
613352991714,1cyclictest0-21swapper/211:30:002
613352991714,1cyclictest0-21swapper/211:15:412
613352991714,1cyclictest0-21swapper/207:55:012
613352991714,1cyclictest0-21swapper/207:30:012
613351991714,2cyclictest768107-21timerwakeupswit09:10:451
613351991714,2cyclictest731905-21systemd-run08:45:011
613351991714,2cyclictest653665-21gltestperf07:40:351
613351991714,2cyclictest1105171-21kthreadcore12:25:391
613351991714,2cyclictest1067372-21aten_repower_cu12:05:291
613351991714,2cyclictest1060065-21kthreadcore12:00:371
613351991712,4cyclictest0-21swapper/108:55:001
61335199171,1cyclictest762253-21diskmemload12:35:001
61335099179,1cyclictest0-21swapper/012:05:520
61335099178,2cyclictest0-21swapper/007:45:010
61335099175,7cyclictest756503-21/usr/sbin/munin09:05:350
61335099174,8cyclictest1002425-21grep11:25:390
61335099173,2cyclictest1092769-21latency_hist12:20:010
613350991715,1cyclictest1652-1atopacctd10:52:570
613350991714,2cyclictest946469-21hddtemp_smartct10:55:350
613350991714,2cyclictest911791-21sort10:35:390
613350991714,2cyclictest762253-21diskmemload12:15:020
613350991712,4cyclictest0-21swapper/007:40:000
61335099170,7cyclictest714885-21ps08:30:380
302487291171,3phc2sys0-21swapper/311:34:433
302487291171,2phc2sys0-21swapper/309:42:333
302487291170,8phc2sys0-21swapper/312:05:293
302487291170,2phc2sys0-21swapper/312:20:103
302487291170,2phc2sys0-21swapper/311:10:123
302487291170,2phc2sys0-21swapper/310:38:373
302487291170,2phc2sys0-21swapper/310:18:093
302487291170,2phc2sys0-21swapper/310:18:093
613352991614,1cyclictest0-21swapper/210:10:402
613352991613,1cyclictest0-21swapper/211:55:022
613352991613,1cyclictest0-21swapper/211:30:412
613352991613,1cyclictest0-21swapper/211:25:012
613352991613,1cyclictest0-21swapper/211:05:012
613352991613,1cyclictest0-21swapper/211:05:012
613352991613,1cyclictest0-21swapper/210:25:002
613352991613,1cyclictest0-21swapper/209:30:012
613352991613,1cyclictest0-21swapper/209:10:012
613352991613,1cyclictest0-21swapper/208:10:412
613352991613,1cyclictest0-21swapper/208:05:002
613352991612,2cyclictest0-21swapper/208:40:322
61335199167,4cyclictest0-21swapper/110:15:311
61335199167,4cyclictest0-21swapper/110:15:311
613351991614,1cyclictest697933-21kthreadcore08:15:381
613351991613,2cyclictest884956-21aten_repower_fr10:20:311
613351991613,2cyclictest627830-21munin-plugin-st07:20:001
613351991612,3cyclictest732554-21cpuspeed_turbos08:45:311
61335099168,4cyclictest0-21swapper/008:25:390
61335099168,2cyclictest0-21swapper/011:10:140
61335099165,4cyclictest790429-21kthreadcore09:25:360
61335099165,1cyclictest0-21swapper/010:14:220
61335099164,1cyclictest689670-21apt-get08:10:290
61335099163,5cyclictest613348-21cyclictest09:45:390
61335099163,3cyclictest806053-21wc09:35:000
613350991614,1cyclictest1102871-21head12:25:350
302487291161,4phc2sys0-21swapper/309:45:313
302487291161,2phc2sys0-21swapper/312:36:243
302487291161,2phc2sys0-21swapper/311:25:343
302487291160,4phc2sys0-21swapper/311:44:213
302487291160,3phc2sys0-21swapper/307:20:353
302487291160,2phc2sys0-21swapper/311:16:283
613352991513,1cyclictest0-21swapper/211:00:022
613352991513,1cyclictest0-21swapper/210:40:012
613352991513,1cyclictest0-21swapper/209:40:012
613352991513,1cyclictest0-21swapper/208:50:012
613352991512,2cyclictest0-21swapper/209:05:012
613352991512,2cyclictest0-21swapper/207:35:002
613352991512,1cyclictest0-21swapper/211:40:022
613352991512,1cyclictest0-21swapper/210:50:352
613352991512,1cyclictest0-21swapper/210:25:382
613352991512,1cyclictest0-21swapper/210:15:362
613352991512,1cyclictest0-21swapper/210:15:362
613352991512,1cyclictest0-21swapper/208:35:352
613352991511,2cyclictest0-21swapper/208:05:432
613352991510,2cyclictest1040778-21turbostat11:50:002
613352991510,2cyclictest1040778-21turbostat11:50:002
61335299150,12cyclictest0-21swapper/209:20:312
613351991512,2cyclictest691101-21kthreadcore08:10:391
613351991512,2cyclictest1042331-21irqcore11:50:401
61335099155,1cyclictest0-21swapper/008:35:360
61335099153,5cyclictest0-21swapper/009:59:480
613350991513,1cyclictest646268-21/usr/sbin/munin07:35:010
613350991512,2cyclictest1652-1atopacctd08:25:010
613350991511,2cyclictest744139-21munin-run08:55:010
61335099150,8cyclictest744318-21/usr/sbin/munin08:55:340
61335099150,6cyclictest0-21swapper/008:05:350
302487291152,3phc2sys0-21swapper/312:30:113
302487291150,4phc2sys0-21swapper/310:05:293
302487291150,3phc2sys0-21swapper/310:41:163
302487291150,3phc2sys0-21swapper/309:24:513
302487291150,2phc2sys0-21swapper/310:12:223
613352991412,1cyclictest0-21swapper/212:00:012
613352991412,1cyclictest0-21swapper/209:44:182
613352991412,1cyclictest0-21swapper/208:50:312
613352991412,1cyclictest0-21swapper/207:45:312
613352991411,2cyclictest0-21swapper/212:30:002
613352991411,2cyclictest0-21swapper/212:15:372
613352991411,1cyclictest0-21swapper/212:05:382
613352991411,1cyclictest0-21swapper/210:40:332
613352991411,1cyclictest0-21swapper/210:30:402
613352991411,1cyclictest0-21swapper/210:05:302
613352991411,1cyclictest0-21swapper/209:30:392
613352991411,1cyclictest0-21swapper/208:15:332
613352991410,2cyclictest0-21swapper/212:37:022
613352991410,1cyclictest0-21swapper/211:05:322
61335199142,3cyclictest0-21swapper/108:35:421
61335199141,4cyclictest701829-21/usr/sbin/munin08:20:351
61335199141,4cyclictest0-21swapper/109:30:181
613351991410,3cyclictest635498-21kthreadcore07:25:481
613351991410,3cyclictest1652-1atopacctd07:20:421
61335099143,2cyclictest726308-21sh08:40:330
613350991411,2cyclictest753223-21kthreadcore09:00:400
613350991411,2cyclictest737135-21sendmail_mailqu08:45:400
613350991411,2cyclictest629210-21cut07:20:400
613350991411,2cyclictest623297-21kthreadcore07:15:550
302487291140,3phc2sys0-21swapper/310:59:343
302487291140,2phc2sys0-21swapper/310:27:273
302487291140,2phc2sys0-21swapper/309:37:133
613352991310,1cyclictest0-21swapper/211:10:402
613352991310,1cyclictest0-21swapper/210:00:002
613352991310,1cyclictest0-21swapper/208:30:382
613352991310,1cyclictest0-21swapper/208:25:372
613352991310,1cyclictest0-21swapper/208:20:372
613352991310,1cyclictest0-21swapper/207:40:372
613351991310,2cyclictest682598-21switchtime08:00:441
61335099136,5cyclictest1635-21dbus-daemon07:10:020
613350991310,2cyclictest677615-21tail08:00:320
302487291131,2phc2sys0-21swapper/308:44:193
302487291130,2phc2sys0-21swapper/312:26:303
302487291130,2phc2sys0-21swapper/312:12:073
302487291130,2phc2sys0-21swapper/311:55:283
302487291130,2phc2sys0-21swapper/311:36:533
302487291130,2phc2sys0-21swapper/311:22:223
302487291130,2phc2sys0-21swapper/310:53:073
302487291130,2phc2sys0-21swapper/309:56:373
302487291130,2phc2sys0-21swapper/309:32:523
302487291130,2phc2sys0-21swapper/309:28:393
302487291130,2phc2sys0-21swapper/309:10:243
302487291130,2phc2sys0-21swapper/309:00:023
61335299129,1cyclictest0-21swapper/207:20:402
61335299124,1cyclictest0-21swapper/212:31:392
613352991210,1cyclictest0-21swapper/211:40:402
613352991210,1cyclictest0-21swapper/207:57:332
613352991210,1cyclictest0-21swapper/207:15:032
302487291121,2phc2sys0-21swapper/307:25:523
302487291121,1phc2sys0-21swapper/310:49:113
302487291120,3phc2sys0-21swapper/312:00:293
302487291120,3phc2sys0-21swapper/309:50:363
302487291120,2phc2sys0-21swapper/308:37:303
302487291120,2phc2sys0-21swapper/308:28:083
302487291120,2phc2sys0-21swapper/308:20:273
302487291120,2phc2sys0-21swapper/307:58:183
302487291120,2phc2sys0-21swapper/307:51:093
302487291120,2phc2sys0-21swapper/307:18:393
302487291120,2phc2sys0-21swapper/307:10:583
61335299119,1cyclictest0-21swapper/208:55:252
61335299119,1cyclictest0-21swapper/207:10:012
61335199110,3cyclictest0-21swapper/107:10:011
302487291114,3phc2sys0-21swapper/309:17:483
302487291113,2phc2sys0-21swapper/311:47:393
302487291113,2phc2sys0-21swapper/311:47:393
302487291111,3phc2sys0-21swapper/311:52:523
302487291111,3phc2sys0-21swapper/310:31:313
302487291110,3phc2sys0-21swapper/312:15:443
302487291110,2phc2sys0-21swapper/309:08:403
302487291110,2phc2sys0-21swapper/308:05:353
302487291110,2phc2sys0-21swapper/307:30:373
302487291101,3phc2sys0-21swapper/307:10:013
302487291100,2phc2sys0-21swapper/311:05:233
302487291100,2phc2sys0-21swapper/308:15:023
302487291100,2phc2sys0-21swapper/307:35:023
30248729191,4phc2sys0-21swapper/308:55:313
30248729190,2phc2sys0-21swapper/308:55:013
30248729190,2phc2sys0-21swapper/308:45:403
30248729190,2phc2sys0-21swapper/308:15:343
30248729190,2phc2sys0-21swapper/308:01:513
30248729190,2phc2sys0-21swapper/307:45:043
30248729190,2phc2sys0-21swapper/307:44:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional