You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 21:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Mon Nov 17, 2025 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317911599721,2cyclictest0-21swapper/109:05:181
317911599653,61cyclictest0-21swapper/111:30:321
317911599652,62cyclictest0-21swapper/111:50:271
317911599643,1cyclictest0-21swapper/108:17:331
317911599641,62cyclictest3177643-21kworker/1:007:14:121
317911599641,62cyclictest0-21swapper/107:24:071
3179115996345,17cyclictest3263882-21kworker/1:111:25:161
317911599632,1cyclictest0-21swapper/107:39:411
317911599621,1cyclictest0-21swapper/111:18:121
317911599620,61cyclictest0-21swapper/112:38:111
317911599620,61cyclictest0-21swapper/111:47:401
317911599620,61cyclictest0-21swapper/111:47:401
317911599611,59cyclictest0-21swapper/110:07:141
3179115996037,21cyclictest1112868-1kworker/1:2H09:05:001
3179115996037,21cyclictest1112868-1kworker/1:2H09:05:001
3179115996037,21cyclictest1112868-1kworker/1:2H07:50:001
3179115995942,16cyclictest3237951-21kworker/1:110:20:171
3179115995942,16cyclictest3237951-21kworker/1:110:20:161
3179115995840,17cyclictest3177643-21kworker/1:007:40:181
3179115995840,17cyclictest3177643-21kworker/1:007:40:171
3179115995755,1cyclictest0-21swapper/112:25:271
3179115995742,14cyclictest3255513-21kworker/1:211:40:011
3179115995742,14cyclictest3211127-21kworker/1:208:50:011
3179115995741,15cyclictest3273616-21kworker/1:312:10:291
3179115995741,15cyclictest1112868-1kworker/1:2H10:40:471
3179115995740,16cyclictest3237951-21kworker/1:110:16:121
3179115995740,16cyclictest3177643-21kworker/1:007:15:021
3179115995735,20cyclictest1112868-1kworker/1:2H08:30:011
317911599570,55cyclictest0-21swapper/111:36:281
3179115995641,14cyclictest3237951-21kworker/1:110:50:161
3179115995641,14cyclictest3177643-21kworker/1:007:50:011
3179115995640,15cyclictest3235871-21kworker/1:010:05:001
3179115995639,16cyclictest3228001-21kworker/1:209:50:011
3179115995639,15cyclictest1112868-1kworker/1:2H09:10:161
3179118995551,2cyclictest130910-1kworker/2:1H07:45:212
3179115995540,14cyclictest3255513-21kworker/1:211:03:421
3179115995540,14cyclictest3219286-21kworker/1:009:26:081
3179115995540,14cyclictest3177643-21kworker/1:008:10:011
3179115995539,15cyclictest3255513-21kworker/1:211:05:151
3179115995539,15cyclictest3228001-21kworker/1:209:46:091
3179115995539,15cyclictest3219286-21kworker/1:009:15:161
3179115995539,15cyclictest3177643-21kworker/1:007:25:161
3179115995538,16cyclictest3177643-21kworker/1:008:40:141
3179115995535,17cyclictest3245518-21kworker/1:010:35:001
3179115995533,20cyclictest1112868-1kworker/1:2H09:40:011
3179122995446,5cyclictest1712070-1kworker/3:2H09:00:173
3179122995446,5cyclictest1712070-1kworker/3:2H09:00:173
3179115995439,14cyclictest3177643-21kworker/1:008:35:181
3179115995439,14cyclictest3177643-21kworker/1:008:20:241
3179115995438,15cyclictest3273616-21kworker/1:312:05:061
3179115995438,15cyclictest3273616-21kworker/1:311:55:151
3179115995438,15cyclictest1112868-1kworker/1:2H10:56:411
3179115995436,14cyclictest3177643-21kworker/1:007:30:241
317911599541,51cyclictest3262833-21fschecks_count11:20:141
3179122995348,3cyclictest3248948-21kworker/3:111:01:413
3179122995347,4cyclictest3278445-21kworker/3:012:24:553
3179122995345,4cyclictest1712070-1kworker/3:2H08:15:193
3179115995338,14cyclictest3284981-21kworker/1:012:30:171
3179115995338,14cyclictest3237951-21kworker/1:110:25:161
3179115995338,14cyclictest3211127-21kworker/1:208:45:121
3179115995338,14cyclictest3177643-21kworker/1:008:05:151
3179115995338,14cyclictest3177643-21kworker/1:007:55:001
3179115995337,15cyclictest3177643-21kworker/1:008:30:181
317911599531,51cyclictest0-21swapper/108:00:261
317911599530,52cyclictest0-21swapper/111:10:111
317911599530,52cyclictest0-21swapper/109:45:011
3179111995350,2cyclictest3197942-21kworker/0:308:08:420
3179111995348,3cyclictest3964510-1kworker/0:0H10:20:020
3179111995348,3cyclictest3964510-1kworker/0:0H10:20:010
3179122995246,4cyclictest1712070-1kworker/3:2H07:20:123
3179118995249,2cyclictest3219239-21kworker/2:009:17:392
3179118995247,3cyclictest130910-1kworker/2:1H09:30:142
3179115995237,14cyclictest3237951-21kworker/1:110:38:431
3179115995236,15cyclictest1112868-1kworker/1:2H10:46:551
3179115995236,15cyclictest1112868-1kworker/1:2H10:10:061
3179115995235,16cyclictest3273616-21kworker/1:312:25:011
3179115995235,16cyclictest3273616-21kworker/1:312:00:151
317911599520,2cyclictest0-21swapper/108:58:121
3179111995249,2cyclictest3964510-1kworker/0:0H10:00:050
3179111995248,2cyclictest3264087-21kworker/0:111:31:460
3179118995147,2cyclictest3254301-21kworker/2:111:25:412
3179118995147,2cyclictest3219239-21kworker/2:009:50:422
3179118995146,3cyclictest130910-1kworker/2:1H07:43:072
3179118995146,3cyclictest130910-1kworker/2:1H07:43:062
3179115995136,14cyclictest3228001-21kworker/1:209:55:181
317911599510,50cyclictest0-21swapper/109:32:421
3179111995148,2cyclictest3252205-21kworker/0:011:35:230
3179111995148,2cyclictest3196004-21kworker/0:208:03:430
3179111995147,2cyclictest3278433-21kworker/0:012:32:030
3179111995147,2cyclictest3252205-21kworker/0:010:51:550
3179111995147,2cyclictest3206000-21kworker/0:108:40:420
3179122995042,5cyclictest1712070-1kworker/3:2H10:25:163
3179118995047,2cyclictest3192817-21kworker/2:208:26:142
3179118995046,3cyclictest3254301-21kworker/2:111:32:412
3179118995045,3cyclictest130910-1kworker/2:1H11:20:142
3179115995035,14cyclictest3219286-21kworker/1:009:20:271
3179115995034,15cyclictest3273616-21kworker/1:312:15:161
3179111995047,2cyclictest3278433-21kworker/0:012:15:250
3179111995047,2cyclictest3252205-21kworker/0:010:59:110
3179111995047,2cyclictest3197942-21kworker/0:308:15:300
3179111995046,2cyclictest3278433-21kworker/0:012:26:530
3179111995046,2cyclictest3252205-21kworker/0:011:01:320
3179111995046,2cyclictest3233838-21kworker/0:010:28:120
3179111995046,2cyclictest3233838-21kworker/0:009:55:120
3179111995046,2cyclictest3217374-21kworker/0:209:15:290
3179111995046,2cyclictest3186253-21kworker/0:007:49:420
3179122994943,3cyclictest1712070-1kworker/3:2H08:09:553
3179122994942,4cyclictest3222484-21kworker/3:009:39:563
3179122994941,5cyclictest1712070-1kworker/3:2H07:56:423
3179118994946,2cyclictest3242280-21kworker/2:010:21:022
3179118994946,2cyclictest3242280-21kworker/2:010:21:022
3179118994946,2cyclictest3192817-21kworker/2:208:19:132
3179118994945,2cyclictest3242280-21kworker/2:010:26:262
3179118994945,2cyclictest3192817-21kworker/2:207:59:132
3179111994946,2cyclictest3248314-21kworker/0:210:45:410
3179111994946,2cyclictest3233838-21kworker/0:010:31:480
3179111994946,2cyclictest3217374-21kworker/0:209:34:430
3179111994946,2cyclictest3217374-21kworker/0:209:07:130
3179111994945,3cyclictest3278433-21kworker/0:012:39:410
3179122994842,3cyclictest1712070-1kworker/3:2H09:15:163
3179122994841,4cyclictest1712070-1kworker/3:2H09:55:173
3179122994832,3cyclictest1712070-1kworker/3:2H11:46:023
3179122994832,3cyclictest1712070-1kworker/3:2H11:46:023
3179118994845,2cyclictest130910-1kworker/2:1H08:09:062
3179118994844,3cyclictest3270333-21kworker/2:212:19:402
3179118994844,3cyclictest3192817-21kworker/2:208:39:122
3179118994844,3cyclictest3192817-21kworker/2:208:12:422
3179118994844,2cyclictest130910-1kworker/2:1H11:55:522
3179118994843,3cyclictest130910-1kworker/2:1H09:11:032
3179111994844,3cyclictest3210876-21kworker/0:008:46:070
3179111994843,3cyclictest3964510-1kworker/0:0H11:50:320
3179122994741,4cyclictest1712070-1kworker/3:2H12:33:423
3179118994744,2cyclictest3270333-21kworker/2:212:00:062
3179118994744,2cyclictest3237413-21kworker/2:110:06:072
3179118994744,2cyclictest3192817-21kworker/2:209:05:432
3179118994744,2cyclictest3192817-21kworker/2:209:01:222
3179118994744,2cyclictest3192817-21kworker/2:209:01:222
3179118994744,2cyclictest130910-1kworker/2:1H07:20:272
3179118994744,2cyclictest130910-1kworker/2:1H07:10:072
3179118994743,3cyclictest3254301-21kworker/2:111:04:522
3179118994743,3cyclictest130910-1kworker/2:1H11:19:402
3179118994742,3cyclictest130910-1kworker/2:1H10:36:092
3179118994741,4cyclictest3254301-21kworker/2:111:36:432
3179111994744,2cyclictest3252205-21kworker/0:011:14:110
3179111994744,2cyclictest3206000-21kworker/0:108:33:430
3179122994639,5cyclictest1712070-1kworker/3:2H07:25:423
3179122994639,4cyclictest1712070-1kworker/3:2H11:31:333
3179122994639,4cyclictest1712070-1kworker/3:2H11:25:163
3179118994643,1cyclictest130910-1kworker/2:1H12:25:152
3179118994642,3cyclictest130910-1kworker/2:1H09:26:262
3179118994642,2cyclictest3176051-21kworker/2:107:15:232
3179111994642,3cyclictest3232218-21kworker/0:209:48:110
3179111994641,3cyclictest3964510-1kworker/0:0H11:06:080
3179122994539,4cyclictest1712070-1kworker/3:2H09:54:563
3179122994538,5cyclictest1712070-1kworker/3:2H11:18:413
3179118994541,2cyclictest130910-1kworker/2:1H12:25:012
3179118994541,2cyclictest130910-1kworker/2:1H11:10:012
3179118994540,3cyclictest130910-1kworker/2:1H07:50:132
3179111994542,2cyclictest3964510-1kworker/0:0H12:10:340
3179111994542,2cyclictest3217374-21kworker/0:209:24:060
3179122994438,3cyclictest1712070-1kworker/3:2H08:20:173
3179122994437,5cyclictest1712070-1kworker/3:2H10:49:553
3179118994441,2cyclictest3219239-21kworker/2:010:00:422
3179118994441,2cyclictest130910-1kworker/2:1H12:38:402
3179118994441,2cyclictest130910-1kworker/2:1H08:54:092
3179111994441,2cyclictest3248314-21kworker/0:210:40:320
3179111994440,2cyclictest3217374-21kworker/0:209:15:000
3179111994440,2cyclictest3214115-21kworker/0:009:00:170
3179111994440,2cyclictest3214115-21kworker/0:009:00:160
3179122994338,3cyclictest3180585-21kworker/3:007:30:223
3179122994338,3cyclictest1712070-1kworker/3:2H09:05:323
3179118994340,2cyclictest130910-1kworker/2:1H10:55:402
3179118994338,3cyclictest130910-1kworker/2:1H12:10:162
3179111994339,2cyclictest3964510-1kworker/0:0H10:35:140
3179111994338,3cyclictest3964510-1kworker/0:0H11:56:290
3179111994337,4cyclictest3964510-1kworker/0:0H08:50:270
3179122994237,3cyclictest1712070-1kworker/3:2H08:51:423
3179122994236,4cyclictest1712070-1kworker/3:2H07:53:413
3179122994235,4cyclictest1712070-1kworker/3:2H10:40:013
3179122994235,3cyclictest1712070-1kworker/3:2H11:20:143
3179118994239,2cyclictest130910-1kworker/2:1H12:05:382
3179118994238,3cyclictest130910-1kworker/2:1H08:48:402
3179118994237,3cyclictest130910-1kworker/2:1H08:30:062
3179111994240,1cyclictest3964510-1kworker/0:0H08:25:160
3179111994239,2cyclictest3964510-1kworker/0:0H11:46:070
3179111994239,2cyclictest3964510-1kworker/0:0H11:46:060
3179111994239,2cyclictest3964510-1kworker/0:0H07:35:050
3179111994239,2cyclictest14-21ksoftirqd/007:20:150
3179111994237,3cyclictest3964510-1kworker/0:0H11:41:070
3179111994236,3cyclictest3964510-1kworker/0:0H10:15:000
3179111994235,5cyclictest3229242-21kworker/0:109:50:150
3179122994135,3cyclictest1712070-1kworker/3:2H12:26:053
3179118994138,2cyclictest130910-1kworker/2:1H10:40:062
3179118994138,2cyclictest130910-1kworker/2:1H07:25:112
3179111994137,2cyclictest3964510-1kworker/0:0H07:30:160
3179122994035,3cyclictest1712070-1kworker/3:2H12:01:503
3179122994035,2cyclictest1712070-1kworker/3:2H08:29:423
3179122994034,3cyclictest1712070-1kworker/3:2H08:39:563
3179118994037,2cyclictest130910-1kworker/2:1H09:40:272
3179118994037,2cyclictest130910-1kworker/2:1H09:36:072
3179111994035,3cyclictest3964510-1kworker/0:0H07:40:130
3179111994035,3cyclictest3964510-1kworker/0:0H07:40:120
3179111994034,4cyclictest3964510-1kworker/0:0H10:15:120
3179118993935,2cyclictest130910-1kworker/2:1H12:30:172
3179118993935,2cyclictest130910-1kworker/2:1H11:15:002
3179111993935,3cyclictest3964510-1kworker/0:0H12:23:400
3179122993835,2cyclictest3222484-21kworker/3:010:05:433
3179122993834,3cyclictest1712070-1kworker/3:2H07:39:553
3179122993834,2cyclictest3222484-21kworker/3:009:24:553
3179122993833,3cyclictest1712070-1kworker/3:2H08:00:313
3179122993832,4cyclictest1712070-1kworker/3:2H08:30:423
3179118993835,2cyclictest130910-1kworker/2:1H11:51:082
3179118993835,2cyclictest130910-1kworker/2:1H10:10:582
3179118993835,2cyclictest130910-1kworker/2:1H08:59:082
3179118993833,3cyclictest130910-1kworker/2:1H08:24:072
3179118993828,7cyclictest130910-1kworker/2:1H10:33:112
3179111993833,3cyclictest3964510-1kworker/0:0H12:10:000
3179122993731,4cyclictest1712070-1kworker/3:2H10:52:413
3179118993734,2cyclictest130910-1kworker/2:1H08:00:262
3179118993732,4cyclictest654-21snmpd10:18:182
3179111993735,1cyclictest3964510-1kworker/0:0H11:16:250
3179111993732,3cyclictest3964510-1kworker/0:0H09:40:080
3179122993633,2cyclictest3278445-21kworker/3:012:12:463
3179122993633,2cyclictest1712070-1kworker/3:2H09:30:063
3179122993632,2cyclictest1712070-1kworker/3:2H11:52:403
317912299362,8cyclictest0-21swapper/309:14:553
317912299362,10cyclictest0-21swapper/309:45:013
3179118993633,2cyclictest130910-1kworker/2:1H08:42:072
3179118993632,3cyclictest130910-1kworker/2:1H09:22:112
3179111993633,2cyclictest3964510-1kworker/0:0H07:56:080
3179111993633,2cyclictest3252205-21kworker/0:011:29:590
3179111993631,4cyclictest3964510-1kworker/0:0H08:39:070
3179122993532,2cyclictest3222484-21kworker/3:009:28:423
3179122993530,3cyclictest1712070-1kworker/3:2H10:15:073
3179122993517,16cyclictest3237369-21sh10:05:003
3179122993514,10cyclictest3243790-21awk10:20:223
3179122993514,10cyclictest3243790-21awk10:20:223
3179118993529,3cyclictest130910-1kworker/2:1H07:35:262
3179111993531,2cyclictest3964510-1kworker/0:0H08:10:180
3179111993530,3cyclictest3964510-1kworker/0:0H12:01:350
317912299348,8cyclictest609-21dbus-daemon11:00:003
3179122993431,2cyclictest1712070-1kworker/3:2H11:39:553
3179122993430,3cyclictest1712070-1kworker/3:2H08:58:413
3179122993429,3cyclictest3180585-21kworker/3:007:15:133
317912299342,17cyclictest0-21swapper/312:05:153
3179118993431,2cyclictest130910-1kworker/2:1H10:45:232
3179122993330,2cyclictest3178927-21kworker/3:207:14:073
3179122993327,4cyclictest609-21dbus-daemon08:10:213
3179122993310,15cyclictest3210274-21ls08:40:163
317911899330,15cyclictest3268960-21munin-node11:40:122
3179111993328,3cyclictest3964510-1kworker/0:0H07:10:270
3179122993229,2cyclictest1712070-1kworker/3:2H07:44:553
3179122993229,2cyclictest1712070-1kworker/3:2H07:44:543
3179122993225,3cyclictest3258016-21grep11:05:163
3179111993228,3cyclictest3964510-1kworker/0:0H07:53:070
3179122993128,2cyclictest3248948-21kworker/3:111:15:013
317912299311,7cyclictest0-21swapper/311:55:143
3179122993111,17cyclictest3270355-21awk11:45:003
3179118993127,3cyclictest130910-1kworker/2:1H10:51:502
3179122993025,3cyclictest3286882-21/usr/sbin/munin12:35:173
3179122993025,3cyclictest1712070-1kworker/3:2H10:34:543
3179122993020,7cyclictest3250496-21grep10:40:213
3179122993012,15cyclictest623-21rs:main3
317911199303,2cyclictest151rcu_preempt07:15:180
3179122992910,6cyclictest3179139-21latency_hist07:10:003
3179118992926,2cyclictest130910-1kworker/2:1H09:57:092
3179118992925,2cyclictest130910-1kworker/2:1H11:50:002
3179118992925,2cyclictest130910-1kworker/2:1H11:50:002
317912299289,11cyclictest3211373-21cat08:45:153
317912299286,8cyclictest3240032-21needreboot10:10:213
3179122992820,5cyclictest3280323-21cat12:15:133
3179111992724,2cyclictest3964510-1kworker/0:0H11:24:060
3179111992712,3cyclictest151rcu_preempt09:00:000
317911199271,15cyclictest3184910-21apt-get07:25:140
317911899260,2cyclictest151rcu_preempt07:30:222
317911599264,21cyclictest251rcuc/107:10:001
3179122992421,2cyclictest0-21swapper/309:45:133
317911199238,2cyclictest151rcu_preempt09:25:200
317911199235,2cyclictest151rcu_preempt09:35:160
3179111992319,3cyclictest3964510-1kworker/0:0H08:23:410
317911199227,3cyclictest151rcu_preempt10:05:190
317911899211,17cyclictest3230862-21/usr/sbin/munin09:45:182
317911899170,4cyclictest3179148-21latency_hist07:10:002
317911199147,3cyclictest3178944-21latency_hist07:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional