You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 00:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Wed Dec 24, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124192237221,11sleep10-21swapper/107:07:021
123592188171,12sleep30-21swapper/307:06:163
123362184166,13sleep00-21swapper/007:05:570
125642174156,13sleep20-21swapper/207:08:552
128439982,3cyclictest3810-21basename11:10:000
128439970,4cyclictest5789-21munin-run08:00:010
128569962,4cyclictest15390-21kworker/3:208:15:023
128569962,4cyclictest15390-21kworker/3:207:56:223
128569962,4cyclictest15390-21kworker/3:207:41:453
128569962,4cyclictest15390-21kworker/3:207:39:573
128569962,4cyclictest15390-21kworker/3:207:33:223
128439960,1cyclictest22651-21sensors07:25:190
128569955,0cyclictest15390-21kworker/3:210:49:533
128569955,0cyclictest15390-21kworker/3:210:05:083
128569955,0cyclictest15390-21kworker/3:209:42:443
128569955,0cyclictest15390-21kworker/3:209:09:113
128569955,0cyclictest15390-21kworker/3:207:50:463
128569952,3cyclictest15390-21kworker/3:208:01:273
128569952,3cyclictest15390-21kworker/3:207:16:393
128569951,4cyclictest15390-21kworker/3:208:20:033
128569951,4cyclictest15390-21kworker/3:208:10:443
128569951,4cyclictest15390-21kworker/3:207:45:023
128569951,4cyclictest15390-21kworker/3:207:29:563
128569950,4cyclictest0-21swapper/309:00:133
128569950,0cyclictest0-21swapper/307:10:193
128519952,1cyclictest0-21swapper/211:25:122
128519950,5cyclictest26313-21apt-get11:55:142
128519950,5cyclictest0-21swapper/210:11:032
128519950,5cyclictest0-21swapper/207:10:182
128469951,2cyclictest0-21swapper/112:35:121
128469951,2cyclictest0-21swapper/111:20:131
128469951,2cyclictest0-21swapper/107:40:111
128439952,2cyclictest0-21swapper/012:10:130
128439952,2cyclictest0-21swapper/009:00:130
128439951,3cyclictest13685-21/usr/sbin/munin12:35:140
128439951,2cyclictest0-21swapper/011:55:130
128439951,2cyclictest0-21swapper/011:40:100
128439951,2cyclictest0-21swapper/009:35:160
128439951,2cyclictest0-21swapper/008:00:120
128439950,5cyclictest0-21swapper/010:45:160
22367240,0sleep10-21swapper/111:45:161
128569944,0cyclictest15390-21kworker/3:208:46:443
128569944,0cyclictest0-21swapper/312:26:293
128569944,0cyclictest0-21swapper/307:20:203
128569943,1cyclictest25035-21ntpq08:35:163
128569942,2cyclictest15390-21kworker/3:212:35:593
128569942,2cyclictest15390-21kworker/3:212:32:083
128569942,2cyclictest15390-21kworker/3:212:23:523
128569942,2cyclictest15390-21kworker/3:212:15:383
128569942,2cyclictest15390-21kworker/3:212:10:553
128569942,2cyclictest15390-21kworker/3:212:05:443
128569942,2cyclictest15390-21kworker/3:212:04:143
128569942,2cyclictest15390-21kworker/3:211:55:463
128569942,2cyclictest15390-21kworker/3:211:52:253
128569942,2cyclictest15390-21kworker/3:211:41:143
128569942,2cyclictest15390-21kworker/3:211:33:033
128569942,2cyclictest15390-21kworker/3:211:20:463
128569942,2cyclictest15390-21kworker/3:211:17:423
128569942,2cyclictest15390-21kworker/3:211:11:073
128569942,2cyclictest15390-21kworker/3:211:01:103
128569942,2cyclictest15390-21kworker/3:210:50:033
128569942,2cyclictest15390-21kworker/3:210:42:223
128569942,2cyclictest15390-21kworker/3:210:35:023
128569942,2cyclictest15390-21kworker/3:210:33:183
128569942,2cyclictest15390-21kworker/3:210:27:073
128569942,2cyclictest15390-21kworker/3:210:20:483
128569942,2cyclictest15390-21kworker/3:210:15:503
128569942,2cyclictest15390-21kworker/3:210:10:023
128569942,2cyclictest15390-21kworker/3:209:50:203
128569942,2cyclictest15390-21kworker/3:209:48:153
128569942,2cyclictest15390-21kworker/3:209:38:263
128569942,2cyclictest15390-21kworker/3:209:30:483
128569942,2cyclictest15390-21kworker/3:209:27:173
128569942,2cyclictest15390-21kworker/3:209:17:483
128569942,2cyclictest15390-21kworker/3:209:10:363
128569942,2cyclictest15390-21kworker/3:208:50:293
128569942,2cyclictest15390-21kworker/3:208:30:023
128569942,1cyclictest32083-21perl09:55:153
128569942,1cyclictest0-21swapper/308:55:133
128569941,3cyclictest15390-21kworker/3:208:05:243
128569941,1cyclictest0-21swapper/311:25:123
128569941,1cyclictest0-21swapper/308:25:113
128569940,4cyclictest16413-21apt-get11:35:123
128569940,4cyclictest0-21swapper/310:57:003
128569940,4cyclictest0-21swapper/310:00:423
128569940,1cyclictest28487-21latency_hist08:45:013
128519943,1cyclictest5297-21ntp_states11:10:182
128519943,1cyclictest25928-21awk10:50:002
128519943,1cyclictest24462-21sort08:35:132
128519942,2cyclictest22069-21gltestperf08:30:292
128519941,1cyclictest0-21swapper/208:45:122
128519940,4cyclictest31271-21apt-get12:05:122
128519940,4cyclictest29962-21memory09:50:192
128519940,4cyclictest2628-21pmu-power12:10:192
128519940,4cyclictest19996-21ntp_states10:35:202
128519940,4cyclictest0-21swapper/212:15:102
128519940,4cyclictest0-21swapper/211:20:192
128519940,4cyclictest0-21swapper/208:26:222
128519940,3cyclictest31917-21df_inode08:50:142
128519940,3cyclictest13451-21latency_hist12:35:002
128519940,3cyclictest11093-21cpu08:10:122
128519940,3cyclictest0-21swapper/210:00:012
128519940,1cyclictest20171-21ntp_states11:40:162
128469944,0cyclictest0-21swapper/112:15:131
128469944,0cyclictest0-21swapper/110:26:061
128469944,0cyclictest0-21swapper/109:20:201
128469944,0cyclictest0-21swapper/108:50:201
128469941,2cyclictest0-21swapper/112:10:121
128469941,2cyclictest0-21swapper/112:05:131
128469941,2cyclictest0-21swapper/111:40:111
128469941,2cyclictest0-21swapper/111:00:141
128469941,2cyclictest0-21swapper/110:35:131
128469941,2cyclictest0-21swapper/110:20:131
128469941,2cyclictest0-21swapper/110:15:121
128469941,2cyclictest0-21swapper/109:55:131
128469941,2cyclictest0-21swapper/109:35:161
128469941,2cyclictest0-21swapper/109:30:131
128469941,2cyclictest0-21swapper/109:00:131
128469941,2cyclictest0-21swapper/108:55:141
128469941,2cyclictest0-21swapper/108:30:261
128469941,2cyclictest0-21swapper/108:20:111
128469941,2cyclictest0-21swapper/108:15:131
128469941,2cyclictest0-21swapper/107:25:121
128469941,2cyclictest0-21swapper/107:10:091
128469941,1cyclictest0-21swapper/109:40:131
128469941,1cyclictest0-21swapper/109:15:141
128469940,3cyclictest0-21swapper/107:45:121
128469940,1cyclictest0-21swapper/108:25:111
128469940,0cyclictest0-21swapper/111:33:361
128439942,1cyclictest28044-21cat10:50:210
128439941,3cyclictest774-21snmpd07:50:160
128439941,3cyclictest10322chrt12:09:410
128439941,2cyclictest0-21swapper/011:15:110
128439941,2cyclictest0-21swapper/010:10:130
128439941,2cyclictest0-21swapper/009:30:130
128439941,2cyclictest0-21swapper/007:35:130
128439941,1cyclictest0-21swapper/010:35:130
128439941,1cyclictest0-21swapper/010:15:120
128439940,4cyclictest28922-21apt-get08:45:110
128439940,4cyclictest13712-21latency_hist10:25:010
128439940,4cyclictest0-21swapper/010:40:120
128439940,4cyclictest0-21swapper/008:40:120
128439940,4cyclictest0-21swapper/008:35:100
128439940,4cyclictest0-21swapper/008:10:210
128439940,4cyclictest0-21swapper/007:30:160
128439940,4cyclictest0-21swapper/007:20:160
128439940,3cyclictest8813-21grep09:10:010
128439940,3cyclictest8705-21cat12:25:000
128439940,3cyclictest32223-21hddtemp_smartct08:50:140
128439940,3cyclictest31174-21cat12:05:000
128439940,3cyclictest18797-21sed09:30:020
128439940,3cyclictest14772-21/usr/sbin/munin10:25:160
128439940,3cyclictest0-21swapper/011:50:110
128439940,3cyclictest0-21swapper/011:30:000
128439940,3cyclictest0-21swapper/009:20:130
128439940,1cyclictest13653-21/usr/sbin/munin08:15:160
128439940,1cyclictest11207-21/usr/sbin/munin12:30:190
128569931,2cyclictest15390-21kworker/3:211:45:123
128569931,1cyclictest0-21swapper/309:20:133
128569930,3cyclictest0-21swapper/311:05:003
128519932,1cyclictest774-21snmpd07:30:072
128519932,1cyclictest758-21runrttasks10:55:102
128519932,1cyclictest495-21nscd07:15:012
128519932,1cyclictest4268-21expr10:05:122
128519932,1cyclictest26404-21seq09:45:102
128519931,1cyclictest0-21swapper/208:55:132
128519931,1cyclictest0-21swapper/207:20:152
128519930,3cyclictest9025-21df08:05:142
128519930,3cyclictest6350-21wget12:20:132
128519930,3cyclictest4571-21wc07:55:162
128519930,3cyclictest31561-21df_inode07:45:142
128519930,3cyclictest25911-21apt-get10:50:002
128519930,3cyclictest24923-21irqstats09:40:162
128519930,3cyclictest21388-21cat10:40:132
128519930,3cyclictest1814-21perl07:50:132
128519930,3cyclictest16781-21df_inode10:30:152
128519930,3cyclictest16579-21cat08:20:122
128519930,3cyclictest16413-21apt-get11:35:132
128519930,3cyclictest14205-21cat09:20:142
128519930,3cyclictest13924-21sshd11:30:062
128519930,3cyclictest13688-21apt-get12:35:122
128519930,3cyclictest0-21swapper/212:25:012
128519930,3cyclictest0-21swapper/211:50:172
128519930,3cyclictest0-21swapper/211:45:012
128519930,3cyclictest0-21swapper/211:15:122
128519930,3cyclictest0-21swapper/211:00:122
128519930,3cyclictest0-21swapper/210:25:012
128519930,3cyclictest0-21swapper/210:15:122
128519930,3cyclictest0-21swapper/209:35:162
128519930,3cyclictest0-21swapper/209:30:022
128519930,3cyclictest0-21swapper/209:25:122
128519930,3cyclictest0-21swapper/209:15:132
128519930,3cyclictest0-21swapper/209:10:132
128519930,3cyclictest0-21swapper/209:05:102
128519930,3cyclictest0-21swapper/209:00:012
128519930,3cyclictest0-21swapper/208:40:092
128519930,3cyclictest0-21swapper/208:15:122
128519930,3cyclictest0-21swapper/208:00:122
128519930,3cyclictest0-21swapper/207:40:112
128519930,3cyclictest0-21swapper/207:35:122
128519930,3cyclictest0-21swapper/207:25:102
128519930,2cyclictest0-21swapper/212:00:092
128519930,2cyclictest0-21swapper/210:20:122
128519930,0cyclictest1116-21apt-get11:05:002
128519930,0cyclictest0-21swapper/210:00:142
128469933,0cyclictest0-21swapper/110:43:171
128469932,1cyclictest0-21swapper/112:20:121
128469931,2cyclictest0-21swapper/108:45:111
128469931,1cyclictest181912chrt10:31:231
128469931,1cyclictest0-21swapper/112:25:131
128469931,1cyclictest0-21swapper/112:00:121
128469931,1cyclictest0-21swapper/111:55:131
128469931,1cyclictest0-21swapper/111:35:121
128469931,1cyclictest0-21swapper/111:25:121
128469931,1cyclictest0-21swapper/111:05:021
128469931,1cyclictest0-21swapper/110:55:121
128469931,1cyclictest0-21swapper/110:45:111
128469931,1cyclictest0-21swapper/109:50:131
128469931,1cyclictest0-21swapper/109:25:121
128469931,1cyclictest0-21swapper/109:05:111
128469931,1cyclictest0-21swapper/108:10:121
128469931,1cyclictest0-21swapper/108:00:111
128469931,1cyclictest0-21swapper/107:20:141
128469930,2cyclictest282002sleep107:38:481
128469930,2cyclictest0-21swapper/111:10:121
128469930,2cyclictest0-21swapper/110:00:151
128469930,2cyclictest0-21swapper/107:15:111
128469930,1cyclictest0-21swapper/108:40:111
128469930,0cyclictest0-21swapper/108:08:351
128439933,0cyclictest0-21swapper/011:35:010
128439932,1cyclictest13941-21apt-get11:30:150
128439931,1cyclictest0-21swapper/010:05:110
128439930,3cyclictest9325-21ls09:10:130
128439930,3cyclictest9174-21/usr/sbin/munin11:20:120
128439930,3cyclictest4214-21/usr/sbin/munin11:10:140
128439930,3cyclictest31037-21dpkg07:45:110
128439930,3cyclictest24466-21diskstats09:40:140
128439930,3cyclictest19138-21df08:25:130
128439930,3cyclictest15397-21munin-node07:15:010
128439930,3cyclictest0-21swapper/012:25:120
128439930,3cyclictest0-21swapper/012:15:040
128439930,3cyclictest0-21swapper/011:45:120
128439930,3cyclictest0-21swapper/011:00:130
128439930,3cyclictest0-21swapper/010:55:120
128439930,3cyclictest0-21swapper/010:30:130
128439930,3cyclictest0-21swapper/009:55:110
128439930,3cyclictest0-21swapper/009:50:130
128439930,3cyclictest0-21swapper/009:15:020
128439930,3cyclictest0-21swapper/008:55:010
128439930,3cyclictest0-21swapper/008:30:000
128439930,3cyclictest0-21swapper/008:20:110
128439930,3cyclictest0-21swapper/008:05:010
128439930,3cyclictest0-21swapper/007:40:110
128439930,3cyclictest0-21swapper/007:10:100
128439930,2cyclictest0-21swapper/009:45:130
128439930,1cyclictest1401-21/usr/sbin/munin10:00:150
128469921,1cyclictest0-21swapper/110:50:011
128469921,1cyclictest0-21swapper/109:45:101
128469921,1cyclictest0-21swapper/109:10:121
128469920,1cyclictest6495-21chrt11:15:101
128469920,1cyclictest6345-21chrt10:10:131
128469920,1cyclictest0-21swapper/112:30:121
128469920,1cyclictest0-21swapper/111:50:101
128469920,1cyclictest0-21swapper/110:05:101
128469920,1cyclictest0-21swapper/108:35:111
128469920,1cyclictest0-21swapper/107:55:121
128469920,1cyclictest0-21swapper/107:50:111
128469910,0cyclictest0-21swapper/107:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional