You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 23:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Mar 18, 2026 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6877212515,76sleep16894-21apt-key07:05:041
6877212515,76sleep16894-21apt-key07:05:041
7034991143,50cyclictest352-21runrttasks12:35:010
7034991133,29cyclictest28380-21latency_hist12:10:030
7034991133,29cyclictest28380-21latency_hist12:10:030
70349911153,7cyclictest0-21swapper/012:05:260
70349911153,7cyclictest0-21swapper/012:05:260
7034991094,54cyclictest352-21runrttasks09:01:230
7034991094,54cyclictest352-21runrttasks09:01:230
70659910859,41cyclictest0-21swapper/211:20:022
70659910859,41cyclictest0-21swapper/211:20:022
70659910857,43cyclictest0-21swapper/209:45:342
70579910864,39cyclictest7015-21cyclictest11:35:331
70659910757,43cyclictest14721-21diskmemload12:02:242
70659910757,43cyclictest14721-21diskmemload12:02:242
70349910554,9cyclictest7015-21cyclictest11:37:480
70659910448,49cyclictest24977-21sh10:15:212
70659910436,14cyclictest0-21swapper/210:30:352
70659910054,38cyclictest0-21swapper/208:05:252
7034991003,44cyclictest352-21runrttasks08:36:110
706599993,38cyclictest10288-21grep07:10:392
7065999916,33cyclictest21621-21latency_hist10:10:032
7065999747,44cyclictest5247-21apt-key12:25:032
7065999732,12cyclictest0-21swapper/212:25:092
7065999732,12cyclictest0-21swapper/212:25:092
706599963,38cyclictest20124-21ntp_kernel_err11:55:272
706599963,38cyclictest20124-21ntp_kernel_err11:55:272
7057999541,46cyclictest9658-21apt-key08:50:041
705799953,80cyclictest19595-21sshd11:55:151
705799953,80cyclictest19595-21sshd11:55:151
7057999527,43cyclictest0-21swapper/111:03:361
7065999436,11cyclictest0-21swapper/207:50:012
706599943,38cyclictest22729-21sshd07:50:152
705799943,67cyclictest25246-21apt-get11:10:191
609629413,54sleep06145-21ls07:00:430
609629413,54sleep06145-21ls07:00:430
137492940,7sleep10-21swapper/109:01:271
137492940,7sleep10-21swapper/109:01:271
706599933,52cyclictest13643-21runrttasks09:01:232
706599933,52cyclictest13643-21runrttasks09:01:232
7065999335,11cyclictest0-21swapper/211:11:322
706599933,41cyclictest13667-21cpuspeed11:45:142
7065999334,13cyclictest0-21swapper/211:05:212
7057999366,18cyclictest277-21dbus-daemon11:10:011
7057999361,22cyclictest27096-21sh09:25:151
7034999375,13cyclictest32757-21/usr/sbin/munin09:35:020
706599923,31cyclictest24582-21grep07:55:212
7065999140,11cyclictest24548-21latency09:20:262
7065999134,11cyclictest0-21swapper/210:25:242
706599904,35cyclictest18933-21latency_hist11:00:032
706599904,35cyclictest18933-21latency_hist11:00:032
7057999042,38cyclictest0-21swapper/108:10:361
7057999042,38cyclictest0-21swapper/108:10:361
7065998972,10cyclictest14721-21diskmemload10:40:212
7065998969,14cyclictest7015-21cyclictest09:25:192
706599893,37cyclictest9411-21apt-key08:50:012
706599892,38cyclictest11372-21latency_hist08:55:022
7034998965,17cyclictest9658-21apt-key08:50:040
7065998836,14cyclictest10291-21latency_hist11:40:022
706599883,36cyclictest11673-21switchtime07:15:332
7057998846,35cyclictest22221-21latency_hist07:50:031
705799883,63cyclictest7296-21apt-get07:05:191
7057998823,37cyclictest14721-21diskmemload09:19:401
7065998754,9cyclictest181rcu_preempt12:30:362
706599863,38cyclictest28687-21/usr/sbin/munin12:10:302
706599863,38cyclictest28687-21/usr/sbin/munin12:10:302
705799863,67cyclictest0-21swapper/108:20:121
706599853,37cyclictest15156-21cstates09:05:152
7057998563,15cyclictest200-21systemd-journal12:18:151
7057998539,38cyclictest0-21swapper/112:20:381
706599843,42cyclictest4759-21ssh10:35:282
7057998469,9cyclictest19235-21latency_hist11:54:591
705799843,66cyclictest0-21swapper/108:00:091
7034998412,26cyclictest58-21kcompactd007:50:230
110762840,6sleep111049-21ssh12:34:581
7065998362,11cyclictest0-21swapper/208:55:282
7057998353,21cyclictest7792-21sh10:40:301
7057998335,41cyclictest0-21swapper/108:50:101
7034998364,11cyclictest0-21swapper/008:34:590
7065998259,14cyclictest14084-21latency_hist07:25:022
7065998259,14cyclictest14084-21latency_hist07:25:022
7065998162,14cyclictest21880-21latency_hist11:05:022
706599813,38cyclictest352-21runrttasks07:43:242
706599813,38cyclictest352-21runrttasks07:43:242
706599813,37cyclictest4529-21modprobe08:34:592
705799812,67cyclictest0-21swapper/109:35:131
705799812,67cyclictest0-21swapper/109:35:131
7034998128,35cyclictest1902-21rm10:30:320
7065998032,24cyclictest0-21swapper/211:31:372
7065998032,24cyclictest0-21swapper/211:31:372
7057998041,34cyclictest0-21swapper/110:15:351
7057998040,34cyclictest1889-21sendmail_mailqu10:30:321
705799793,71cyclictest0-21swapper/107:20:151
705799793,71cyclictest0-21swapper/107:20:151
705799792,67cyclictest0-21swapper/111:40:121
7034997959,14cyclictest25019-21apt-key11:10:040
7034997950,14cyclictest14864-21ssh11:46:070
7065997861,11cyclictest7015-21cyclictest07:35:142
7065997861,11cyclictest7015-21cyclictest07:35:142
7065997859,9cyclictest0-21swapper/210:10:352
7065997858,13cyclictest298-21in:imuxsock09:15:012
7065997857,8cyclictest181rcu_preempt12:19:582
7065997843,7cyclictest0-21swapper/209:51:122
705799783,65cyclictest27696-21ssh10:20:101
705799783,65cyclictest27696-21ssh10:20:101
705799783,62cyclictest12795-21ssh09:55:101
7057997826,46cyclictest0-21swapper/107:39:591
7057997826,46cyclictest0-21swapper/107:39:591
705799782,49cyclictest22868-21ssh10:10:441
7034997861,7cyclictest0-21swapper/009:05:240
7065997758,9cyclictest0-21swapper/207:30:032
7057997762,9cyclictest18450-21modprobe10:05:001
7057997762,9cyclictest18450-21modprobe10:05:001
7057997756,14cyclictest27169-21sh12:06:341
7057997756,14cyclictest27169-21sh12:06:341
705799774,44cyclictest865-21apt10:29:591
705799773,60cyclictest0-21swapper/108:55:121
7057997732,37cyclictest0-21swapper/111:25:271
7057997727,42cyclictest0-21swapper/108:31:541
705799772,70cyclictest0-21swapper/110:55:151
705799772,70cyclictest0-21swapper/110:55:151
7034997735,11cyclictest181rcu_preempt12:10:340
7034997735,11cyclictest181rcu_preempt12:10:340
7065997662,8cyclictest0-21swapper/209:55:272
7057997659,11cyclictest365-21ntpd09:10:381
7057997658,12cyclictest26756-21latency_hist09:25:031
705799763,67cyclictest0-21swapper/110:50:131
705799763,66cyclictest28678-21rm11:15:261
705799763,66cyclictest28678-21rm11:15:261
7057997635,31cyclictest0-21swapper/112:04:491
7057997635,31cyclictest0-21swapper/112:04:491
705799763,52cyclictest9800-21apt-get09:50:151
7057997633,33cyclictest0-21swapper/109:30:151
7057997632,36cyclictest0-21swapper/112:25:531
7057997632,36cyclictest0-21swapper/112:25:531
705799762,68cyclictest0-21swapper/111:45:131
705799762,64cyclictest0-21swapper/108:15:131
7034997658,12cyclictest19676-21snmpd08:25:150
7034997653,16cyclictest12398-21latency_hist07:20:020
7034997647,20cyclictest28925-21munin-run08:10:000
7034997640,15cyclictest26153-21ssh10:16:310
7065997557,9cyclictest0-21swapper/210:55:022
7065997557,12cyclictest2170-21processes08:25:312
705799756,57cyclictest0-21swapper/107:25:141
7057997534,33cyclictest0-21swapper/108:05:331
7057997532,36cyclictest0-21swapper/110:39:071
7057997527,39cyclictest0-21swapper/111:30:141
7057997527,39cyclictest0-21swapper/111:30:141
7057997526,37cyclictest0-21swapper/111:24:591
7034997561,10cyclictest7015-21cyclictest10:10:250
7034997559,9cyclictest0-21swapper/011:20:180
7034997557,9cyclictest0-21swapper/010:25:340
7034997556,11cyclictest352-21runrttasks10:43:520
703499754,55cyclictest24079-21ssh09:20:110
7034997535,16cyclictest0-21swapper/009:37:100
7034997535,16cyclictest0-21swapper/009:37:100
7065997459,8cyclictest0-21swapper/207:05:062
7065997455,10cyclictest0-21swapper/210:25:022
7065997455,10cyclictest0-21swapper/210:25:022
7057997434,33cyclictest0-21swapper/110:45:291
7057997434,33cyclictest0-21swapper/109:05:361
7057997428,39cyclictest0-21swapper/107:54:591
7034997453,15cyclictest20749-21sendmail09:15:000
7065997359,10cyclictest7015-21cyclictest09:44:282
7065997357,7cyclictest0-21swapper/211:25:012
705799733,63cyclictest0-21swapper/110:05:121
7057997327,38cyclictest0-21swapper/108:39:181
705799732,57cyclictest2927-21sh08:29:591
7034997356,11cyclictest5779-21ssh11:30:470
7034997356,11cyclictest5779-21ssh11:30:470
7034997342,10cyclictest58-21kcompactd009:51:410
7065997251,8cyclictest181rcu_preempt08:00:202
705799723,63cyclictest0-21swapper/107:40:151
705799723,63cyclictest0-21swapper/107:40:151
7057997227,38cyclictest0-21swapper/107:15:211
705799722,65cyclictest0-21swapper/109:40:161
705799722,56cyclictest28711-21apt-get12:10:111
705799722,56cyclictest28711-21apt-get12:10:111
7057997213,40cyclictest14721-21diskmemload09:48:091
7034997257,9cyclictest4304-21sh11:29:590
7034997257,9cyclictest32494-21cpuspeed08:20:160
7034997256,8cyclictest0-21swapper/012:29:520
7034997256,8cyclictest0-21swapper/012:29:520
7034997239,11cyclictest0-21swapper/008:40:100
7065997144,19cyclictest14721-21diskmemload10:45:182
705799713,57cyclictest0-21swapper/108:40:111
7057997126,39cyclictest0-21swapper/107:10:131
7065997054,8cyclictest0-21swapper/209:35:562
7065997054,8cyclictest0-21swapper/209:35:562
7065997054,8cyclictest0-21swapper/207:06:072
7065997051,8cyclictest0-21swapper/208:40:032
7065997048,17cyclictest1359-21latency_hist08:25:012
7065997046,8cyclictest181rcu_preempt08:15:342
705799702,56cyclictest0-21swapper/107:30:131
705799702,56cyclictest0-21swapper/107:30:131
7034997052,13cyclictest0-21swapper/009:00:020
7034997045,19cyclictest27583-21ssh09:25:270
7034996948,15cyclictest22568-21latency_hist12:00:030
7034996948,15cyclictest22568-21latency_hist12:00:030
7034996948,14cyclictest9264-21grep09:50:020
7034996938,13cyclictest181rcu_preempt10:35:120
703499693,57cyclictest20123-21grep11:00:360
703499693,38cyclictest22176-21users09:15:390
7034996926,34cyclictest27311-21latency_hist08:05:020
703499692,58cyclictest7341-21runrttasks07:05:390
7065996849,14cyclictest28384-21sh12:09:592
7065996849,14cyclictest28384-21sh12:09:592
7065996844,9cyclictest181rcu_preempt11:25:092
7065996839,10cyclictest181rcu_preempt11:45:022
7065996829,14cyclictest181rcu_preempt10:04:592
7065996829,14cyclictest181rcu_preempt10:04:592
7034996850,13cyclictest7015-21cyclictest07:40:350
7034996850,13cyclictest7015-21cyclictest07:40:350
703499684,54cyclictest352-21runrttasks09:55:270
7034996841,21cyclictest2491-21fschecks_count12:20:190
7034996835,9cyclictest0-21swapper/010:45:130
703499683,35cyclictest13926-21switchtime10:50:330
7065996752,10cyclictest17815-21sh11:51:022
7065996744,9cyclictest181rcu_preempt09:15:262
7057996714,47cyclictest25713-21cut08:00:021
7034996734,12cyclictest0-21swapper/011:15:250
7034996734,12cyclictest0-21swapper/011:15:250
703499673,35cyclictest2010-21sed12:20:010
703499672,37cyclictest352-21runrttasks08:10:110
703499672,37cyclictest352-21runrttasks08:10:110
7065996645,11cyclictest0-21swapper/207:05:052
7034996647,13cyclictest25710-21fschecks_count11:11:170
703499664,51cyclictest11120-21load11:40:260
7034996639,10cyclictest14979-21kworker/u18:0-events_unbound07:20:210
7034996639,10cyclictest14979-21kworker/u18:0-events_unbound07:20:210
7034996610,46cyclictest9883-21apt-get08:50:140
7065996547,13cyclictest0-21swapper/209:30:162
7034996546,10cyclictest21605-21sh10:10:020
703499654,51cyclictest29007-21ssh10:21:120
703499654,51cyclictest29007-21ssh10:21:120
703499653,43cyclictest17009-21cat11:50:240
165472650,7sleep00-21swapper/010:55:260
165472650,7sleep00-21swapper/010:55:260
706999648,40cyclictest7006-21taskset09:45:243
7065996423,17cyclictest0-21swapper/208:13:582
7065996423,17cyclictest0-21swapper/208:13:582
703499647,29cyclictest6289-21modprobe09:44:590
7034996449,10cyclictest58-21kcompactd007:39:590
7034996449,10cyclictest58-21kcompactd007:39:590
7034996435,9cyclictest181rcu_preempt07:25:510
7065996346,10cyclictest0-21swapper/208:40:162
7034996348,10cyclictest7015-21cyclictest07:57:070
7034996346,11cyclictest352-21runrttasks10:00:300
7034996346,11cyclictest352-21runrttasks10:00:300
706999623,46cyclictest22041-21taskset10:10:253
7065996245,10cyclictest0-21swapper/207:35:032
7065996245,10cyclictest0-21swapper/207:35:032
7034996236,19cyclictest0-21swapper/007:10:240
703499622,35cyclictest16293-21fschecks_time07:30:240
703499622,35cyclictest16293-21fschecks_time07:30:240
706999613,41cyclictest1935-21taskset12:19:583
706999613,39cyclictest8266-21taskset10:40:373
703499613,41cyclictest352-21runrttasks08:15:110
7034996118,30cyclictest22571-21apt-config07:50:030
706999603,42cyclictest23523-21taskset12:01:263
706999603,42cyclictest23523-21taskset12:01:263
706999593,44cyclictest6412-21taskset08:40:103
706999584,37cyclictest31073-21chrt08:15:203
658925814,25sleep30-21swapper/307:03:143
658925814,25sleep30-21swapper/307:03:143
706999574,36cyclictest9078-21taskset08:46:143
706999573,41cyclictest2707-21chrt11:25:383
706999564,39cyclictest20956-21taskset09:15:033
706999564,37cyclictest6533-21chrt09:45:033
706999563,40cyclictest10569-21taskset08:51:133
706999563,35cyclictest19270-21taskset10:05:263
706999562,41cyclictest18506-21chrt07:35:353
706999562,41cyclictest18506-21chrt07:35:353
706999562,40cyclictest18549-21taskset10:59:263
706999562,40cyclictest18549-21taskset10:59:263
706999562,38cyclictest13554-21chrt11:45:083
706999554,35cyclictest24767-21chrt10:15:153
706999553,38cyclictest8595-21chrt12:30:183
706999553,38cyclictest5487-21taskset12:25:173
706999553,38cyclictest5487-21taskset12:25:173
706999553,36cyclictest11358-21chrt11:40:343
706999552,37cyclictest15992-21chrt09:05:353
706999544,37cyclictest28236-21taskset10:20:263
706999544,37cyclictest28236-21taskset10:20:263
706999543,40cyclictest22273-21chrt07:50:003
706999543,35cyclictest21709-21chrt09:15:323
706999534,37cyclictest28882-21taskset12:10:173
706999534,37cyclictest28882-21taskset12:10:173
706999534,36cyclictest29424-21chrt08:10:223
706999534,36cyclictest29424-21chrt08:10:223
706999534,34cyclictest1055-21taskset11:24:163
706999533,36cyclictest8862-21chrt07:10:033
706999533,35cyclictest24568-21chrt11:09:393
706999533,34cyclictest7480-21taskset11:35:023
706999533,34cyclictest7480-21taskset11:35:023
7069995314,27cyclictest15372-21chrt09:59:473
706999524,35cyclictest11793-21taskset08:55:223
706999523,37cyclictest11658-21taskset09:52:463
706999523,36cyclictest32655-21taskset10:28:083
706999522,39cyclictest11497-21chrt10:46:213
706999522,37cyclictest3729-21chrt12:21:413
706999513,37cyclictest28881-21chrt11:15:323
706999513,37cyclictest28881-21chrt11:15:323
706999513,32cyclictest22602-21chrt12:00:043
706999513,32cyclictest22602-21chrt12:00:043
706999512,40cyclictest14773-21chrt09:05:023
706999512,40cyclictest14773-21chrt09:05:023
706999512,36cyclictest24280-21chrt07:55:033
706999512,34cyclictest27508-21chrt08:05:033
706999504,31cyclictest917-21kworker/3:1+events10:30:293
706999503,32cyclictest27083-21taskset09:25:133
706999494,31cyclictest20777-21chrt07:45:023
706999494,31cyclictest20777-21chrt07:45:023
706999493,37cyclictest21206-21taskset11:03:313
706999493,32cyclictest19144-21chrt11:54:493
706999492,34cyclictest28096-21chrt12:09:123
706999492,34cyclictest28096-21chrt12:09:123
706999492,33cyclictest14357-21chrt10:51:033
706999484,29cyclictest24066-21taskset09:20:103
706999483,35cyclictest26093-21taskset11:11:273
706999483,35cyclictest1100-21chrt09:35:263
706999483,35cyclictest1100-21chrt09:35:263
706999483,34cyclictest30591-21taskset09:30:283
706999473,32cyclictest10367-21chrt11:40:013
706999473,29cyclictest24681-21chrt07:55:233
706999473,29cyclictest16928-21chrt07:30:453
706999473,29cyclictest16928-21chrt07:30:453
706999463,33cyclictest28065-21chrt08:05:283
706999463,31cyclictest11743-21chrt07:15:343
7069994615,22cyclictest0-21swapper/307:25:203
706999454,24cyclictest917-21kworker/3:1+events08:30:033
706999453,32cyclictest6259-21chrt08:40:023
706999453,31cyclictest6048-21taskset10:37:453
706999453,30cyclictest1059-21taskset08:21:483
706999443,31cyclictest17094-21chrt10:01:133
706999443,31cyclictest17094-21chrt10:01:133
706999443,30cyclictest4581-21chrt08:35:003
706999432,30cyclictest13852-21taskset07:24:173
706999432,30cyclictest13852-21taskset07:24:173
706999412,28cyclictest10525-21taskset07:13:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional