You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 10:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sat Dec 06, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41823222970,2sleep30-21swapper/323:30:203
38292162880,2sleep30-21swapper/319:45:093
3783366992822,2cyclictest17450irq/132-ahci[0000:00:17.0]00:35:000
41216722250,2sleep20-21swapper/222:55:322
3783367992515,3cyclictest37926-21kthreadcore00:00:161
3783367992514,3cyclictest52441-21/usr/sbin/munin00:10:151
39448522230,1sleep13944856-21cut21:15:161
3783367992320,2cyclictest0-21swapper/120:50:001
378336699225,7cyclictest4124857-21aten2.4-expect23:00:070
3783366992216,2cyclictest170550irq/121-eno123:10:140
3783366992215,6cyclictest4072446-21/usr/sbin/munin22:30:020
3783366992214,4cyclictest3933517-21cstates21:10:090
3783366992211,6cyclictest4119779-21kthreadcore22:55:160
3783370992119,1cyclictest0-21swapper/221:54:412
3783367992118,2cyclictest4028751-21grep22:05:011
3783367992112,1cyclictest170550irq/121-eno119:20:071
378336699217,7cyclictest4189125-21kthreadcore23:35:160
378336699216,9cyclictest70218-21aten2.4-expect00:20:070
3783366992119,1cyclictest34604-21latency_hist00:00:000
3783366992111,4cyclictest3895633-21sshd20:36:340
3783370992017,1cyclictest0-21swapper/200:30:022
3783370992010,2cyclictest0-21swapper/222:30:342
378336799204,8cyclictest3967515-21systemd-run21:30:001
378336799204,8cyclictest3967515-21systemd-run21:30:001
378336699208,8cyclictest4048893-21grep22:15:170
378336699206,8cyclictest79030-21aten2.4-expect00:25:110
3783366992017,2cyclictest1635-21dbus-daemon22:55:010
3783366992014,5cyclictest3950407-21/usr/sbin/munin21:20:150
378336699201,10cyclictest102958-1ssh00:37:050
3783370991916,1cyclictest0-21swapper/200:15:012
378336799193,7cyclictest78459-21munin-run00:25:001
3783367991916,2cyclictest104646-21run-parts00:40:001
3783367991916,2cyclictest0-21swapper/100:30:021
3783367991910,2cyclictest170550irq/121-eno123:46:231
378336699195,9cyclictest52532-21aten2.4-expect00:10:070
378336699195,8cyclictest9112-21aten2.4-expect23:45:080
378336699193,5cyclictest3804237-21aten2.4-expect19:25:070
3783366991915,2cyclictest0-21swapper/020:50:000
3783366991914,4cyclictest3816671-21cpuspeed_turbos19:35:090
3783366991912,6cyclictest62136-21/usr/sbin/munin00:15:110
3783366991912,5cyclictest1803-21gdbus22:10:010
3783366991912,2cyclictest171ktimers/022:49:460
378336699191,16cyclictest0-21swapper/021:50:080
3783366991911,4cyclictest3908700-21aten2.4-expect20:50:080
3783366991910,5cyclictest4178184-21kthreadcore23:30:140
378336699190,5cyclictest3992611-21ssh21:43:240
302487291190,2phc2sys0-21swapper/321:10:393
378337099187,3cyclictest0-21swapper/220:40:012
3783370991815,1cyclictest0-21swapper/200:35:112
3783367991815,2cyclictest52268-21latency_hist00:10:011
3783367991815,2cyclictest4167867-21/usr/sbin/munin23:25:011
3783367991815,2cyclictest4098867-21cpu22:45:071
3783367991815,2cyclictest3919576-21proc_pri20:55:181
3783367991815,2cyclictest1700-21systemd-logind23:55:011
3783367991815,2cyclictest1-21systemd23:45:001
3783367991814,3cyclictest4180823-21cut23:30:151
3783367991814,3cyclictest1702-21in:imuxsock21:35:011
378336699189,5cyclictest38950-21tr00:00:160
378336699187,6cyclictest4017153-21diskmemload21:55:410
378336699186,7cyclictest4097301-21diskmemload22:43:130
378336699182,4cyclictest271irq_work/023:26:450
378336699181,5cyclictest4150957-21aten2.4-expect23:15:090
3783366991815,2cyclictest3883724-21apt-key20:30:010
3783366991815,2cyclictest1661-21polkitd21:20:020
3783366991814,3cyclictest3960456-21kthreadcore21:25:180
3783366991814,3cyclictest3960456-21kthreadcore21:25:180
3783366991812,5cyclictest4081085-21/usr/sbin/munin22:35:020
3783366991811,2cyclictest4019748-21perf22:04:560
3783366991810,4cyclictest4081301-21aten2.4-expect22:35:070
302487291180,2phc2sys0-21swapper/321:28:143
302487291180,2phc2sys0-21swapper/321:28:143
3783370991714,1cyclictest0-21swapper/222:54:502
3783370991714,1cyclictest0-21swapper/220:59:312
3783370991714,1cyclictest0-21swapper/200:20:142
3783370991714,1cyclictest0-21swapper/200:00:012
3783370991713,2cyclictest0-21swapper/219:55:022
3783367991715,1cyclictest3783364-21cyclictest21:05:001
3783367991714,2cyclictest4072330-21grep22:30:011
3783367991714,2cyclictest4013129-21kthreadcore21:55:131
3783367991714,2cyclictest3809902-21turbostat19:30:001
3783367991714,2cyclictest3788608-21mailstats19:10:191
3783367991714,2cyclictest1652-1atopacctd23:25:171
378336799171,3cyclictest3889810-21latency_hist20:35:011
378336799171,3cyclictest34586-21latency_hist00:00:021
3783367991713,3cyclictest89310-21kthreadcore00:30:171
3783367991712,1cyclictest170550irq/121-eno122:35:011
378336699179,4cyclictest3822447-21aten2.4-expect19:40:070
378336699176,5cyclictest4133565-21tail23:05:070
3783366991714,2cyclictest3969176-21kthreadcore21:30:140
3783366991714,2cyclictest3932778-21systemd-run21:10:000
3783366991714,2cyclictest3923641-21kthreadcore21:00:160
3783366991714,2cyclictest3902027-21systemd-run20:45:000
3783366991714,2cyclictest3836220-21kthreadcore19:50:130
3783366991713,3cyclictest3917476-21kthreadcore20:55:150
3783366991713,3cyclictest3866815-21kthreadcore20:15:140
3783366991713,3cyclictest3856133-21kthreadcore20:05:120
3783366991713,3cyclictest3784909-21kthreadcore19:10:140
3783366991713,3cyclictest1635-21dbus-daemon23:25:010
3783366991712,1cyclictest170550irq/121-eno122:20:120
3783366991711,2cyclictest45960-21kthreadcore00:05:140
3783366991710,6cyclictest0-21swapper/023:40:140
302487291170,3phc2sys0-21swapper/300:16:233
302487291170,2phc2sys0-21swapper/322:32:263
302487291170,2phc2sys0-21swapper/321:52:473
302487291170,2phc2sys0-21swapper/300:05:133
378337099161,4cyclictest0-21swapper/200:20:012
3783370991614,1cyclictest0-21swapper/223:45:162
3783370991614,1cyclictest0-21swapper/220:30:012
3783370991613,1cyclictest0-21swapper/223:35:142
3783370991613,1cyclictest0-21swapper/223:14:122
3783370991613,1cyclictest0-21swapper/223:10:002
3783370991613,1cyclictest0-21swapper/219:40:002
3783370991613,1cyclictest0-21swapper/219:20:082
3783370991613,1cyclictest0-21swapper/200:01:492
3783370991612,2cyclictest0-21swapper/221:48:362
378336799166,3cyclictest170550irq/121-eno121:10:071
378336799163,6cyclictest501rcuop/222:13:131
378336799163,6cyclictest501rcuop/222:13:131
378336799161,4cyclictest4037526-21latency_hist22:10:011
3783367991614,1cyclictest3977835-21kthreadcore21:35:141
3783367991613,2cyclictest4124425-21sendmail23:00:001
3783367991613,2cyclictest4110170-21kthreadcore22:50:151
3783367991613,2cyclictest3890859-21gltestperf20:35:101
3783367991613,2cyclictest3858341-21mailstats20:05:161
3783367991613,2cyclictest3783364-21cyclictest23:10:011
3783367991613,2cyclictest3783364-21cyclictest22:40:021
3783367991612,3cyclictest4125917-21irqcore23:00:121
378336799160,8cyclictest3902109-21cat20:45:001
378336699166,6cyclictest3871685-21aten2.4-expect20:20:080
378336699166,6cyclictest3840964-21aten2.4-expect19:55:060
378336699164,8cyclictest4002475-21unin-run21:50:000
378336699163,8cyclictest3976489-21ssh21:35:060
378336699161,4cyclictest3852744-21cron20:05:000
3783366991613,2cyclictest3790122-21kthreadcore19:15:030
3783366991613,2cyclictest3790122-21kthreadcore19:15:030
3783366991613,2cyclictest18708-21irqcore23:50:110
3783366991612,3cyclictest3800830-21kthreadcore19:20:140
3783366991612,1cyclictest170550irq/121-eno122:10:080
3783366991612,1cyclictest170550irq/121-eno122:10:080
302487291163,2phc2sys0-21swapper/300:37:393
302487291160,3phc2sys0-21swapper/323:46:573
302487291160,3phc2sys0-21swapper/323:42:323
302487291160,2phc2sys0-21swapper/321:41:363
3783370991513,1cyclictest0-21swapper/223:25:182
3783370991513,1cyclictest0-21swapper/220:50:012
3783370991512,1cyclictest0-21swapper/223:51:492
3783370991512,1cyclictest0-21swapper/223:30:142
3783370991512,1cyclictest0-21swapper/223:15:192
3783370991512,1cyclictest0-21swapper/222:40:012
3783370991512,1cyclictest0-21swapper/222:25:002
3783370991512,1cyclictest0-21swapper/222:16:412
3783370991512,1cyclictest0-21swapper/222:00:142
3783370991512,1cyclictest0-21swapper/222:00:012
3783370991512,1cyclictest0-21swapper/220:25:002
3783367991512,2cyclictest4093469-21kthreadcore22:40:171
3783367991512,2cyclictest4059005-21kthreadcore22:20:191
3783367991512,2cyclictest3843295-21kthreadcore19:55:131
3783367991512,2cyclictest3783364-21cyclictest21:05:111
3783367991511,3cyclictest3989874-21kthreadcore21:40:131
3783367991511,3cyclictest3941511-21kworker/u16:2+nfsiod21:48:071
3783367991511,3cyclictest1700-21systemd-logind19:40:021
3783367991510,3cyclictest0-21swapper/119:45:001
378336799150,7cyclictest3840797-21cat19:55:021
3783366991512,2cyclictest3810335-21aten_repower_po19:30:080
3783366991511,3cyclictest3885352-21kthreadcore20:30:160
3783366991511,3cyclictest3859473-21aten_repower_cu20:10:110
302487291150,2phc2sys0-21swapper/323:58:083
302487291150,2phc2sys0-21swapper/323:02:233
302487291150,2phc2sys0-21swapper/322:24:523
302487291150,2phc2sys0-21swapper/300:29:433
3783370991412,1cyclictest0-21swapper/223:05:012
3783370991412,1cyclictest0-21swapper/220:55:002
3783370991412,1cyclictest0-21swapper/200:30:212
3783370991411,2cyclictest0-21swapper/221:30:102
3783370991411,1cyclictest0-21swapper/223:45:002
3783370991411,1cyclictest0-21swapper/222:45:012
3783370991411,1cyclictest0-21swapper/222:27:342
3783370991411,1cyclictest0-21swapper/222:05:152
3783370991411,1cyclictest0-21swapper/221:41:572
3783370991411,1cyclictest0-21swapper/221:25:092
3783370991411,1cyclictest0-21swapper/221:25:092
3783370991411,1cyclictest0-21swapper/221:20:092
3783370991411,1cyclictest0-21swapper/221:15:122
3783370991411,1cyclictest0-21swapper/221:10:132
3783370991411,1cyclictest0-21swapper/200:06:162
378336799148,2cyclictest170550irq/121-eno123:36:401
378336799148,2cyclictest170550irq/121-eno123:17:331
378336799147,2cyclictest170550irq/121-eno122:15:241
378336799147,2cyclictest170550irq/121-eno120:50:161
3783367991411,2cyclictest3872384-21idleruntime20:20:111
3783367991411,2cyclictest3862227-21sort20:10:181
3783367991411,2cyclictest3832679-21kthreadcore19:45:151
3783367991410,3cyclictest4145793-21kthreadcore23:10:141
3783367991410,3cyclictest4006508-21kthreadcore21:50:141
3783367991410,3cyclictest3951799-21kthreadcore21:20:141
3783367991410,3cyclictest3849199-21kthreadcore20:00:141
3783367991410,3cyclictest3794714-21kthreadcore19:15:141
3783367991410,3cyclictest3794714-21kthreadcore19:15:141
3783366991411,2cyclictest3830976-21kthreadcore19:45:140
302487291141,2phc2sys0-21swapper/321:56:553
302487291140,2phc2sys0-21swapper/323:17:323
302487291140,2phc2sys0-21swapper/322:12:083
302487291140,2phc2sys0-21swapper/322:12:083
302487291140,2phc2sys0-21swapper/300:12:543
378337099131,5cyclictest0-21swapper/219:30:012
3783370991311,1cyclictest0-21swapper/220:05:012
3783370991311,1cyclictest0-21swapper/220:00:002
3783370991311,1cyclictest0-21swapper/219:15:022
3783370991311,1cyclictest0-21swapper/219:15:022
3783370991310,2cyclictest0-21swapper/220:05:122
3783370991310,1cyclictest0-21swapper/222:45:072
3783370991310,1cyclictest0-21swapper/222:10:222
3783370991310,1cyclictest0-21swapper/222:10:222
3783370991310,1cyclictest0-21swapper/221:35:152
3783370991310,1cyclictest0-21swapper/220:15:202
3783370991310,1cyclictest0-21swapper/219:45:112
3783370991310,1cyclictest0-21swapper/219:40:202
378336799135,3cyclictest170550irq/121-eno100:15:101
3783367991310,2cyclictest3877878-21cpu20:25:101
3783367991310,2cyclictest3868061-21kthreadcore20:15:141
378336699134,8cyclictest1-21systemd19:10:020
302487291131,3phc2sys0-21swapper/320:40:213
302487291130,5phc2sys0-21swapper/319:05:063
302487291130,4phc2sys0-21swapper/319:20:063
302487291130,2phc2sys0-21swapper/323:22:523
302487291130,2phc2sys0-21swapper/323:13:073
302487291130,2phc2sys0-21swapper/323:09:293
302487291130,2phc2sys0-21swapper/321:47:183
378337099129,1cyclictest0-21swapper/221:05:162
378337099129,1cyclictest0-21swapper/219:10:142
378337099123,6cyclictest41675752sleep223:24:392
3783367991210,1cyclictest8351-21rtkit-daemon19:33:511
302487291122,3phc2sys0-21swapper/321:23:573
302487291121,2phc2sys0-21swapper/300:03:083
302487291120,3phc2sys0-21swapper/323:35:073
302487291120,3phc2sys0-21swapper/320:55:083
302487291120,2phc2sys0-21swapper/322:52:573
302487291120,2phc2sys0-21swapper/320:04:343
378337099119,1cyclictest0-21swapper/220:40:142
378337099119,1cyclictest0-21swapper/220:30:172
378337099119,1cyclictest0-21swapper/220:10:112
378337099119,1cyclictest0-21swapper/219:30:072
378337099118,1cyclictest0-21swapper/221:00:142
302487291113,2phc2sys0-21swapper/320:35:083
302487291113,2phc2sys0-21swapper/320:05:183
302487291112,2phc2sys0-21swapper/323:52:383
302487291111,2phc2sys0-21swapper/321:30:143
302487291110,2phc2sys0-21swapper/322:44:203
302487291110,2phc2sys0-21swapper/322:27:313
302487291110,2phc2sys0-21swapper/322:07:523
302487291110,2phc2sys0-21swapper/320:20:223
302487291110,2phc2sys0-21swapper/320:10:593
302487291110,2phc2sys0-21swapper/300:24:203
302487291110,1phc2sys0-21swapper/320:19:583
378337099108,1cyclictest0-21swapper/219:10:022
378336799105,4cyclictest3783450-21cat19:10:021
302487291102,2phc2sys0-21swapper/321:15:483
302487291101,3phc2sys0-21swapper/320:50:013
302487291101,2phc2sys0-21swapper/322:00:163
302487291101,2phc2sys0-21swapper/320:25:113
302487291100,3phc2sys0-21swapper/321:05:023
302487291100,3phc2sys0-21swapper/319:25:113
302487291100,2phc2sys0-21swapper/323:25:053
302487291100,2phc2sys0-21swapper/322:55:303
302487291100,2phc2sys0-21swapper/322:38:563
302487291100,2phc2sys0-21swapper/322:17:553
302487291100,2phc2sys0-21swapper/319:40:093
302487291100,2phc2sys0-21swapper/300:33:463
30248729191,2phc2sys0-21swapper/321:07:343
30248729190,3phc2sys0-21swapper/321:35:113
30248729190,2phc2sys0-21swapper/322:45:083
30248729190,2phc2sys0-21swapper/320:50:113
30248729190,2phc2sys0-21swapper/320:30:153
30248729190,2phc2sys0-21swapper/320:00:013
30248729190,2phc2sys0-21swapper/319:50:393
30248729190,2phc2sys0-21swapper/319:30:083
30248729190,2phc2sys0-21swapper/319:15:093
30248729190,2phc2sys0-21swapper/319:15:093
30248729180,3phc2sys0-21swapper/319:10:113
30248729180,2phc2sys0-21swapper/319:35:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional