You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 21:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 30, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
262539912042,27cyclictest0-21swapper/009:36:110
262539912042,27cyclictest0-21swapper/009:36:110
2579221187,17sleep00-21swapper/006:51:560
2579221187,17sleep00-21swapper/006:51:560
262539910738,21cyclictest25526-21apt-get08:26:100
262709910541,55cyclictest0-21swapper/211:40:592
262539910532,31cyclictest7762-21apt-get10:51:080
262539910417,43cyclictest15352-21latency_hist08:00:590
262709910336,11cyclictest0-21swapper/211:21:272
262709910240,8cyclictest0-21swapper/208:06:372
262709910153,41cyclictest13939-21fschecks_time11:01:182
262709910138,12cyclictest0-21swapper/206:56:142
262709910043,51cyclictest0-21swapper/210:16:292
262709910043,51cyclictest0-21swapper/210:16:292
262539910021,35cyclictest0-21swapper/008:06:220
26270999933,10cyclictest0-21swapper/210:56:192
26270999933,10cyclictest0-21swapper/210:56:192
26253999829,30cyclictest31077-21apt-get10:36:100
26253999829,30cyclictest31077-21apt-get10:36:100
2627099973,40cyclictest15993-21kernelversion08:01:222
26253999712,44cyclictest31713-21ssh09:43:320
2627099963,39cyclictest30306-21fschecks_count07:06:182
26270999628,32cyclictest17233-21tune2fs12:01:182
2627099953,37cyclictest28858-21latency07:01:252
26270999518,33cyclictest18815-21timerwakeupswit09:21:342
26253999528,27cyclictest28103-21apt-get10:31:300
26253999521,33cyclictest0-21swapper/009:06:140
2627099943,41cyclictest5838-21grep09:01:132
2627099942,37cyclictest32243-21fschecks_time08:46:172
26253999420,24cyclictest9361-21ssh10:01:010
26253999420,24cyclictest9361-21ssh10:01:010
247802948,20sleep30-21swapper/306:51:103
247802948,20sleep30-21swapper/306:51:103
13012940,5sleep20-21swapper/208:51:172
2627099934,36cyclictest20001-21if_eth011:11:202
2627099933,37cyclictest12413-21cpu07:51:132
2627099933,36cyclictest5818-21cat11:41:322
2627099933,36cyclictest5818-21cat11:41:322
2627099923,46cyclictest15693-21apt-get10:11:122
2627099923,39cyclictest20909-21/usr/sbin/munin09:26:302
2627099923,38cyclictest31845-21fschecks_time11:31:172
2627099923,38cyclictest31845-21fschecks_time11:31:172
2627099923,34cyclictest14769-21find07:56:322
2627099923,32cyclictest29639-21grep08:36:352
26270999231,9cyclictest0-21swapper/208:36:002
26253999229,27cyclictest857-21apt-get07:16:080
26270999140,10cyclictest298-21in:imuxsock08:19:242
2627099913,35cyclictest30527-21runrttasks09:41:272
2627099913,35cyclictest25898-21ps10:27:232
26270999132,12cyclictest0-21swapper/207:16:182
26270999132,11cyclictest0-21swapper/208:12:352
2625399918,45cyclictest0-21swapper/011:41:060
2625399918,45cyclictest0-21swapper/011:41:060
26253999120,30cyclictest24369-21apt-get10:26:110
26270999072,11cyclictest13045-21sh10:06:252
2627099905,45cyclictest4891-21taskset10:46:252
2627099905,45cyclictest4891-21taskset10:46:252
2627099903,36cyclictest29243-21grep10:31:522
2627099903,35cyclictest26783-21ssh09:36:002
2627099903,35cyclictest13929-21/usr/sbin/munin11:56:262
2627099903,34cyclictest3911-21latency_hist07:26:002
2627099903,33cyclictest6811-21idleruntime09:56:202
2627099903,33cyclictest6811-21idleruntime09:56:202
26253999063,19cyclictest5703-21apt-get07:31:120
26253999027,50cyclictest6864-21unixbench_singl09:01:340
26253999027,38cyclictest0-21swapper/011:11:130
26253999026,25cyclictest27971-21latency_hist07:01:000
26253999021,31cyclictest10173-21/usr/sbin/munin10:01:300
2627099894,35cyclictest352-21runrttasks09:18:122
26270998937,9cyclictest31595-21latency10:36:282
26270998937,9cyclictest31595-21latency10:36:282
2627099892,35cyclictest25330-21latency_hist08:26:002
2627099892,35cyclictest25330-21latency_hist08:26:002
2626299897,60cyclictest15153-21apt-get10:11:141
2626299894,64cyclictest17497-21apt-get08:06:191
26253998911,31cyclictest0-21swapper/011:31:170
26253998911,31cyclictest0-21swapper/011:31:170
2627099883,35cyclictest12133-21modprobe10:05:562
2627099883,34cyclictest31698-21munin-run08:45:572
2627099883,34cyclictest29594-21latency_hist09:41:002
2627099883,34cyclictest29594-21latency_hist09:41:002
26270998827,12cyclictest0-21swapper/210:53:532
2627099882,36cyclictest5515-21latency_hist07:30:592
2627099882,36cyclictest5515-21latency_hist07:30:592
26253998824,26cyclictest3049-21rm10:42:390
26253998823,28cyclictest32331-21sendmail_mailqu07:11:290
26253998818,28cyclictest7042-21apt-get07:36:110
26253998818,28cyclictest7042-21apt-get07:36:110
26253998815,44cyclictest13711-21rm09:13:390
26253998812,28cyclictest0-21swapper/008:51:070
26270998737,10cyclictest541-21cpu09:46:112
2627099873,33cyclictest8928-21latency_hist07:40:592
2627099873,33cyclictest8928-21latency_hist07:40:592
2627099873,33cyclictest22870-21fschecks_time11:16:192
26270998732,32cyclictest10591-21sh09:08:262
26270998731,11cyclictest0-21swapper/211:53:552
26270998731,11cyclictest0-21swapper/211:53:552
26253998725,24cyclictest26075-21fschecks_count12:16:180
26253998721,31cyclictest24615-21/usr/sbin/munin09:31:330
26253998720,43cyclictest4212-21apt-get10:46:110
26253998720,43cyclictest4212-21apt-get10:46:110
26253998718,28cyclictest30550-21sort08:41:200
26253998712,26cyclictest0-21swapper/009:46:120
26270998616,28cyclictest6283-21grep07:31:292
26262998667,12cyclictest7490-21ssh10:50:591
26262998667,12cyclictest7490-21ssh10:50:591
26253998627,21cyclictest20572-21ssh09:25:560
26253998618,29cyclictest0-21swapper/008:56:090
26253998618,28cyclictest352-21runrttasks08:32:170
26253998612,32cyclictest10493-21latency_hist07:45:590
26253998612,32cyclictest10493-21latency_hist07:45:590
26270998566,13cyclictest1765-21fschecks_count10:41:162
2627099854,33cyclictest28890-21fschecks_time11:26:202
2627099853,37cyclictest352-21runrttasks12:21:312
2627099853,37cyclictest352-21runrttasks12:21:312
26262998546,9cyclictest181rcu_preempt12:00:141
26253998560,17cyclictest2497-21diskmemload11:16:220
26253998525,24cyclictest29548-21cat12:21:290
26253998525,24cyclictest29548-21cat12:21:290
26253998524,28cyclictest23889-21apt-get08:21:080
26253998524,28cyclictest23889-21apt-get08:21:080
26253998522,37cyclictest10709-21apt-get10:56:120
26253998522,37cyclictest10709-21apt-get10:56:120
26253998522,22cyclictest0-21swapper/009:30:040
26253998519,28cyclictest16962-21/usr/sbin/munin10:12:000
26253998514,31cyclictest18662-21sshd11:09:080
26253998514,31cyclictest18662-21sshd11:09:080
2627099843,35cyclictest352-21runrttasks07:49:382
26262998468,11cyclictest26241-21cyclictest12:16:071
26253998457,19cyclictest26425-21threads11:21:300
26253998426,23cyclictest4051-21ssh09:51:250
26253998424,47cyclictest24575-21ssh10:25:590
26253998424,20cyclictest20415-21sh12:06:220
26253998420,27cyclictest8002-21/usr/sbin/munin11:46:350
2627099834,31cyclictest6140-21latency_hist09:56:012
26253998320,22cyclictest0-21swapper/007:46:330
26253998317,27cyclictest17312-21dpkg08:06:010
26253998315,24cyclictest25697-21cat12:16:000
26253998315,24cyclictest25697-21cat12:16:000
26270998257,19cyclictest1-21systemd09:16:002
2627099824,32cyclictest352-21runrttasks12:19:322
26253998224,28cyclictest12897-21/usr/sbin/munin10:06:220
26253998219,28cyclictest15153-21fschecks_count09:16:210
26253998153,21cyclictest28584-21ssh11:26:100
26253998120,27cyclictest28869-21cat07:01:250
26253998120,18cyclictest30863-21threads07:06:310
26253998118,25cyclictest17999-21/usr/sbin/munin12:01:330
26253998113,46cyclictest0-21swapper/007:21:080
2627099803,35cyclictest352-21runrttasks08:27:332
2625399804,41cyclictest352-21runrttasks11:59:190
26253998024,19cyclictest3338-21rm11:37:060
26253998015,23cyclictest0-21swapper/010:16:400
26253998015,23cyclictest0-21swapper/010:16:400
2627099793,38cyclictest352-21runrttasks12:13:282
2627099793,38cyclictest352-21runrttasks12:13:282
2627099793,34cyclictest24445-21ssh10:25:582
26253997938,34cyclictest0-21swapper/011:51:100
26253997938,34cyclictest0-21swapper/011:51:100
26253997920,22cyclictest0-21swapper/008:16:140
26253997917,27cyclictest13978-21fschecks_time11:01:190
26253997917,24cyclictest5459-21modprobe07:30:570
26253997917,24cyclictest5459-21modprobe07:30:570
26253997916,14cyclictest31978-21apt-get08:46:090
26253997915,29cyclictest29291-21taskset08:36:300
259532796,54sleep20-21swapper/206:54:062
259532796,54sleep20-21swapper/206:54:062
26253997827,22cyclictest12383-21/usr/sbin/munin07:51:300
26262997758,12cyclictest31-21ksoftirqd/111:54:231
26262997758,12cyclictest31-21ksoftirqd/111:54:231
2627799763,34cyclictest30436-21taskset09:41:253
26262997660,10cyclictest6619-21switchtime09:01:321
26262997660,10cyclictest10674-21idleruntime-cro11:50:561
26262997642,9cyclictest181rcu_preempt10:56:081
26262997642,9cyclictest181rcu_preempt10:56:081
26262997559,10cyclictest2497-21diskmemload10:56:001
2626299754,47cyclictest9025-21latency_hist07:41:051
2626299754,47cyclictest9025-21latency_hist07:41:051
2627799743,34cyclictest28834-21taskset10:31:463
26262997453,15cyclictest13159-21threads07:51:311
26262997447,7cyclictest181rcu_preempt09:16:151
26262997351,16cyclictest32677-21latency_hist09:45:591
26262997351,15cyclictest7160-21apt-key07:36:001
26262997350,16cyclictest1-21systemd09:26:081
2627799723,33cyclictest16370-21chrt09:17:373
2627099722,24cyclictest20792-21/usr/sbin/munin12:06:312
26262997254,12cyclictest732-21sh10:39:321
26262997254,12cyclictest732-21sh10:39:321
26262997249,16cyclictest7793-21latency_hist11:45:591
26262997249,16cyclictest7793-21latency_hist11:45:591
26262997235,7cyclictest181rcu_preempt10:31:201
26253997214,19cyclictest0-21swapper/008:11:250
2627799715,45cyclictest0-21swapper/310:26:133
2627799712,29cyclictest12852-21chrt09:11:333
26277997110,40cyclictest0-21swapper/310:11:123
26270997152,13cyclictest8347-21fschecks_time11:46:212
26270997152,13cyclictest31690-21/usr/sbin/munin07:11:222
26262997157,10cyclictest26241-21cyclictest10:08:491
26262997155,10cyclictest29039-21latency11:26:241
26262997153,12cyclictest2497-21diskmemload12:15:581
26262997153,12cyclictest2497-21diskmemload12:15:581
26262997151,14cyclictest17041-21if_eth011:06:191
26262997151,14cyclictest17041-21if_eth011:06:191
26262997149,15cyclictest26241-21cyclictest10:28:211
26262997137,9cyclictest21451-21ssh12:07:501
2627799703,30cyclictest2435-21chrt07:21:013
2626299705,34cyclictest6439-21/usr/sbin/munin09:56:341
2626299705,34cyclictest6439-21/usr/sbin/munin09:56:341
26262997051,12cyclictest1-21systemd09:21:371
26262997049,15cyclictest2374-21systemd-journal08:44:081
2626299704,42cyclictest1948-21taskset11:36:001
2626299704,42cyclictest1948-21taskset11:36:001
2616527015,29sleep10-21swapper/106:56:011
2616527015,29sleep10-21swapper/106:56:011
26270996952,11cyclictest3820-21sh08:56:352
26262996952,10cyclictest0-21swapper/109:46:301
26262996947,16cyclictest300-21rs:main1
2626299693,47cyclictest10350-21ssh09:07:451
2627799683,32cyclictest716-21chrt10:39:293
2627799683,32cyclictest716-21chrt10:39:293
2627799683,24cyclictest27829-21chrt08:31:343
26262996850,12cyclictest24376-21idleruntime-cro10:25:561
26262996842,9cyclictest181rcu_preempt11:11:111
2626299683,44cyclictest3760-21fschecks_time09:51:191
2626299683,38cyclictest1-21systemd12:05:581
2626299682,54cyclictest18704-21ssh10:16:091
2626299682,54cyclictest18704-21ssh10:16:091
2627799673,29cyclictest28431-21taskset12:20:493
2627799672,21cyclictest1381-21chrt08:51:183
26270996748,13cyclictest352-21runrttasks11:07:302
26270996748,13cyclictest352-21runrttasks11:07:302
26262996739,19cyclictest29803-21modprobe07:05:571
26262996738,21cyclictest9478-21cut07:42:241
26262996738,21cyclictest9478-21cut07:42:241
2627799663,23cyclictest27521-21chrt09:36:273
2627799663,23cyclictest27521-21chrt09:36:273
2627799663,21cyclictest27811-21chrt11:24:493
2627799662,29cyclictest22448-21chrt08:19:343
2627799662,26cyclictest10415-21chrt07:45:073
2627799662,26cyclictest10415-21chrt07:45:073
26262996652,10cyclictest26241-21cyclictest08:19:151
2626299663,53cyclictest13678-21ssh11:01:091
26262996634,9cyclictest181rcu_preempt07:46:111
2626299663,42cyclictest352-21runrttasks08:04:241
2626299663,41cyclictest3461-21open_files08:56:301
2626299663,26cyclictest24177-21fschecks_count09:31:211
26262996631,24cyclictest25933-21if_eth011:21:191
2626299662,28cyclictest12105-21fschecks_count09:11:181
26262996622,13cyclictest181rcu_preempt12:23:021
26262996622,13cyclictest181rcu_preempt12:23:021
2627799653,26cyclictest6856-21chrt10:49:183
2627799653,26cyclictest6856-21chrt10:49:183
2627799653,24cyclictest30456-21chrt12:23:083
2627799653,24cyclictest30456-21chrt12:23:083
2627799653,23cyclictest30253-21chrt07:06:153
2627799653,23cyclictest19813-21chrt11:11:153
2627799653,22cyclictest2005-21chrt11:36:033
2627799652,30cyclictest16337-21chrt12:00:153
26262996551,10cyclictest26044-21kworker/u17:3-writeback09:37:221
26262996551,10cyclictest26044-21kworker/u17:3-writeback09:37:221
26262996548,12cyclictest58-21kcompactd008:35:571
26262996541,13cyclictest0-21swapper/106:56:221
2626299653,41cyclictest12170-21sendmail10:05:571
26262996527,30cyclictest30045-21kworker/u18:0+nfsiod10:41:201
2627799643,24cyclictest31705-21chrt11:31:133
2627799643,24cyclictest31705-21chrt11:31:133
2627799643,24cyclictest11747-21chrt10:04:533
2627799643,21cyclictest8051-21chrt07:37:053
2627799643,21cyclictest8051-21chrt07:37:053
2627799643,21cyclictest13914-21chrt11:01:183
2627799643,20cyclictest594-21chrt09:46:123
2627799642,29cyclictest30832-21taskset08:41:263
2627799642,25cyclictest7350-21taskset09:02:493
2627799642,25cyclictest18725-21chrt10:16:123
2627799642,25cyclictest18725-21chrt10:16:123
2627799642,24cyclictest14022-21chrt07:56:133
2627799642,22cyclictest3984-21chrt08:56:453
26262996448,11cyclictest26241-21cyclictest08:51:181
26262996440,9cyclictest181rcu_preempt08:46:201
26262996440,17cyclictest26241-21cyclictest07:09:321
2626299643,40cyclictest352-21runrttasks08:12:311
2626299643,40cyclictest1387-21ntp_offset07:16:261
2626299642,43cyclictest32236-21ntp_offset07:11:251
2627799633,24cyclictest3921-21chrt09:51:233
2627799633,24cyclictest17942-21taskset12:01:323
2627799633,23cyclictest9027-21taskset09:06:183
2627799633,23cyclictest681-21chrt08:48:393
2627799633,23cyclictest10166-21chrt11:49:333
2627799633,22cyclictest28979-21chrt11:26:233
2627799633,22cyclictest22563-21chrt09:28:033
2627799633,21cyclictest29874-21chrt07:05:583
2627799633,21cyclictest19928-21chrt12:06:103
2627799633,21cyclictest12377-21chrt10:58:103
2627799633,21cyclictest12377-21chrt10:58:103
2627799632,25cyclictest13748-21taskset07:55:573
2627799632,24cyclictest12657-21chrt10:06:153
2627799632,23cyclictest5743-21taskset11:41:313
2627799632,23cyclictest5743-21taskset11:41:313
2627799632,22cyclictest19634-21chrt08:11:243
2627099636,31cyclictest26295-21kworker/2:2-events07:42:272
2627099636,31cyclictest26295-21kworker/2:2-events07:42:272
2626299638,44cyclictest2957-21ntp_kernel_err07:21:251
26262996342,14cyclictest352-21runrttasks11:40:081
2626299633,42cyclictest23901-21cpu08:21:131
2626299633,42cyclictest23901-21cpu08:21:131
2626299633,38cyclictest15344-21modprobe08:00:571
2627799623,23cyclictest6874-21chrt07:33:573
2627799623,22cyclictest24965-21chrt08:22:383
2627799623,22cyclictest24965-21chrt08:22:383
2627799623,22cyclictest24847-21chrt11:19:503
2627799622,24cyclictest18291-21taskset09:21:223
2627799622,24cyclictest1558-21chrt10:41:073
2627799622,22cyclictest23969-21taskset09:31:153
2627799622,22cyclictest15624-21chrt08:01:113
2627799622,20cyclictest1308-21chrt07:16:233
2626299623,39cyclictest22574-21/usr/sbin/munin11:16:071
2627799613,22cyclictest12383-21chrt11:52:253
2627799613,22cyclictest12383-21chrt11:52:253
2627799613,21cyclictest9183-21chrt10:52:303
2627799613,21cyclictest22177-21chrt10:21:233
2627799613,21cyclictest18052-21chrt11:07:223
2627799613,21cyclictest18052-21chrt11:07:223
2627799613,20cyclictest26578-21chrt06:56:143
2627799612,24cyclictest8118-21taskset09:58:083
2627799612,24cyclictest8118-21taskset09:58:083
2627799612,21cyclictest17528-21chrt08:06:263
2627799612,21cyclictest11932-21chrt07:48:283
26262996138,12cyclictest0-21swapper/108:36:321
2626299612,34cyclictest352-21runrttasks07:29:491
2626299612,34cyclictest352-21runrttasks07:29:491
2627799604,19cyclictest29945-21chrt08:39:193
2627799603,21cyclictest26778-21chrt08:29:553
2627799602,22cyclictest25327-21chrt12:15:263
2627799602,22cyclictest25327-21chrt12:15:263
2627799602,21cyclictest31714-21chrt07:11:093
2627799592,21cyclictest5216-21chrt07:28:143
2627799592,21cyclictest5216-21chrt07:28:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional