You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 14:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 16, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7713214411,93sleep27788-21cstates18:52:172
8756211911,87sleep00-21swapper/018:53:340
1554621070,7sleep10-21swapper/123:36:281
2715421050,7sleep10-21swapper/121:13:081
91809910459,8cyclictest181rcu_preempt20:36:582
9169999714,32cyclictest25164-21/usr/sbin/munin22:57:330
9173999560,9cyclictest181rcu_preempt00:11:581
9173999560,9cyclictest181rcu_preempt00:11:581
917399953,72cyclictest4373-21ssh23:18:011
917399953,72cyclictest4373-21ssh23:18:011
9173999425,19cyclictest0-21swapper/121:29:081
9180999370,15cyclictest170-21jbd2/mmcblk2p2-821:07:002
9180999237,17cyclictest0-21swapper/219:50:132
9173999147,12cyclictest181rcu_preempt22:18:311
85872917,54sleep18671-21sed18:52:451
9180998959,8cyclictest181rcu_preempt21:20:252
9180998947,16cyclictest181rcu_preempt22:18:162
9180998913,50cyclictest39-21ksoftirqd/222:57:292
9173998953,13cyclictest181rcu_preempt21:33:461
9173998953,13cyclictest181rcu_preempt21:33:461
9173998937,33cyclictest0-21swapper/123:51:461
9180998874,10cyclictest9156-21cyclictest19:11:582
9180998860,7cyclictest181rcu_preempt22:01:342
9173998854,7cyclictest181rcu_preempt21:02:211
9173998837,28cyclictest0-21swapper/122:06:491
9173998758,21cyclictest1-21systemd21:54:071
9173998758,21cyclictest1-21systemd21:54:071
9173998738,26cyclictest0-21swapper/123:24:301
9173998730,28cyclictest9156-21cyclictest22:13:161
9173998730,28cyclictest9156-21cyclictest22:13:161
9173998665,16cyclictest9156-21cyclictest19:39:071
9173998655,8cyclictest181rcu_preempt21:59:021
916999864,31cyclictest0-21swapper/021:16:560
9180998537,27cyclictest0-21swapper/219:17:312
9180998537,27cyclictest0-21swapper/219:17:312
9173998551,11cyclictest181rcu_preempt22:27:281
9173998547,15cyclictest181rcu_preempt22:22:011
9173998547,15cyclictest181rcu_preempt22:22:011
9180998452,12cyclictest181rcu_preempt21:30:072
9180998450,13cyclictest181rcu_preempt22:06:032
9180998412,46cyclictest39-21ksoftirqd/220:47:272
9173998459,8cyclictest181rcu_preempt20:02:311
9173998438,22cyclictest9156-21cyclictest23:55:011
9173998438,22cyclictest9156-21cyclictest23:55:011
9169998449,29cyclictest31350-21fschecks_time00:02:170
9169998449,29cyclictest31350-21fschecks_time00:02:170
9180998351,9cyclictest181rcu_preempt20:27:072
9180998329,11cyclictest0-21swapper/221:39:132
9173998355,8cyclictest181rcu_preempt21:09:341
9173998355,8cyclictest181rcu_preempt00:22:301
9173998353,9cyclictest181rcu_preempt23:13:301
9173998353,9cyclictest181rcu_preempt23:13:301
9173998350,12cyclictest181rcu_preempt22:47:171
9173998342,21cyclictest181rcu_preempt21:01:011
9173998339,10cyclictest0-21swapper/122:58:161
9173998338,23cyclictest9156-21cyclictest20:17:271
9169998366,11cyclictest2374-21systemd-journal20:20:190
9180998250,14cyclictest181rcu_preempt19:12:062
9180998250,14cyclictest181rcu_preempt19:12:062
9180998243,20cyclictest11177-21munin-node20:02:232
9173998247,7cyclictest181rcu_preempt20:12:181
9173998243,9cyclictest181rcu_preempt23:06:571
9173998239,8cyclictest181rcu_preempt20:47:211
9180998160,11cyclictest0-21swapper/221:42:182
9180998160,11cyclictest0-21swapper/221:42:182
9180998152,9cyclictest181rcu_preempt18:57:282
9180998144,13cyclictest181rcu_preempt00:14:142
9180998139,11cyclictest181rcu_preempt22:29:392
9180998138,11cyclictest181rcu_preempt23:16:592
9180998138,11cyclictest181rcu_preempt23:16:592
9180998138,10cyclictest0-21swapper/219:42:232
9173998159,15cyclictest9156-21cyclictest20:31:581
9173998144,11cyclictest9156-21cyclictest20:32:081
9173998133,27cyclictest0-21swapper/119:22:351
9173998130,22cyclictest0-21swapper/119:12:191
9173998130,22cyclictest0-21swapper/119:12:191
9173998126,21cyclictest0-21swapper/121:17:541
9169998164,11cyclictest22373-21systemd-run21:06:570
9169998160,15cyclictest29715-21cron23:06:560
9169998149,24cyclictest0-21swapper/021:37:070
9180998062,10cyclictest381ktimers/223:18:012
9180998062,10cyclictest381ktimers/223:18:012
9180998056,12cyclictest0-21swapper/200:17:162
9180998051,8cyclictest181rcu_preempt22:52:312
9180998049,9cyclictest181rcu_preempt21:53:162
9180998049,9cyclictest181rcu_preempt21:53:162
9180998048,9cyclictest181rcu_preempt19:27:172
9180998048,9cyclictest181rcu_preempt19:27:172
9180998048,8cyclictest181rcu_preempt00:09:042
9180998048,8cyclictest181rcu_preempt00:09:042
9180998045,9cyclictest181rcu_preempt19:37:182
9180998027,10cyclictest0-21swapper/223:48:082
9180998016,39cyclictest39-21ksoftirqd/221:47:242
9180998014,41cyclictest39-21ksoftirqd/219:52:132
9180998014,41cyclictest39-21ksoftirqd/219:52:132
9173998061,11cyclictest28358-21fschecks_time23:57:201
9173998054,10cyclictest181rcu_preempt00:16:351
9173998052,8cyclictest181rcu_preempt19:48:331
9173998052,8cyclictest181rcu_preempt00:18:061
9173998042,10cyclictest181rcu_preempt00:06:131
9173998042,10cyclictest181rcu_preempt00:06:131
9173998039,8cyclictest181rcu_preempt21:42:271
9173998039,8cyclictest181rcu_preempt21:42:271
9173998039,11cyclictest12359-21switchtime19:02:541
9173998038,12cyclictest181rcu_preempt22:34:551
9169998059,15cyclictest5284-21sh21:31:560
9169998059,15cyclictest4876-21fschecks_time00:12:180
9169998059,15cyclictest20851-21latency_hist22:51:580
9169998011,35cyclictest19523-21/usr/sbin/munin23:42:200
9169998011,35cyclictest19523-21/usr/sbin/munin23:42:200
9180997961,12cyclictest32209-21modprobe22:16:562
9180997961,12cyclictest32209-21modprobe22:16:562
9180997957,11cyclictest0-21swapper/222:42:192
9180997916,33cyclictest39-21ksoftirqd/221:36:582
9180997916,33cyclictest39-21ksoftirqd/221:36:582
9173997950,13cyclictest181rcu_preempt22:07:221
9173997935,16cyclictest181rcu_preempt21:37:141
9173997928,21cyclictest0-21swapper/122:45:301
9169997916,34cyclictest13149-21cat23:32:110
9180997843,7cyclictest181rcu_preempt22:33:022
9173997845,11cyclictest181rcu_preempt19:57:051
9173997845,11cyclictest181rcu_preempt19:57:051
9173997842,10cyclictest181rcu_preempt22:56:581
9169997858,14cyclictest32607-21idleruntime-cro20:06:560
9169997820,27cyclictest16999-21rm22:44:510
9180997760,8cyclictest0-21swapper/220:37:182
9180997757,10cyclictest0-21swapper/222:07:002
9180997751,9cyclictest181rcu_preempt22:41:462
9180997750,8cyclictest181rcu_preempt00:01:582
9180997742,10cyclictest181rcu_preempt23:29:082
9180997742,10cyclictest181rcu_preempt23:29:082
9180997729,10cyclictest0-21swapper/219:57:172
9180997729,10cyclictest0-21swapper/219:57:172
917399777,38cyclictest31-21ksoftirqd/119:17:181
917399777,38cyclictest31-21ksoftirqd/119:17:181
9173997749,8cyclictest181rcu_preempt20:23:321
9173997749,8cyclictest181rcu_preempt20:23:321
9173997732,23cyclictest0-21swapper/119:52:161
9173997732,23cyclictest0-21swapper/119:52:161
9173997731,25cyclictest9156-21cyclictest23:40:031
9180997662,10cyclictest9156-21cyclictest22:22:332
9180997662,10cyclictest9156-21cyclictest22:22:332
9180997658,9cyclictest0-21swapper/222:47:162
9180997647,8cyclictest181rcu_preempt00:02:032
9180997647,8cyclictest181rcu_preempt00:02:032
9180997638,15cyclictest28366-21kworker/u18:1-rpciod00:24:122
9180997632,20cyclictest0-21swapper/220:42:312
9180997629,25cyclictest0-21swapper/223:07:002
9173997646,10cyclictest181rcu_preempt19:33:121
9173997641,14cyclictest181rcu_preempt23:07:301
9173997628,26cyclictest0-21swapper/123:42:161
9173997628,26cyclictest0-21swapper/123:42:161
9173997619,32cyclictest0-21swapper/119:42:521
9169997659,11cyclictest14958-21kworker/u17:2+rpciod21:08:100
9169997654,16cyclictest10888-21cut00:22:180
9169997651,19cyclictest29479-21ssh21:17:560
9169997616,32cyclictest6608-21sendmail20:26:570
9169997616,32cyclictest6608-21sendmail20:26:570
9169997613,21cyclictest14925-21taskset20:52:040
9180997545,9cyclictest181rcu_preempt23:10:412
9180997537,17cyclictest0-21swapper/220:07:342
9180997522,17cyclictest11886-21fschecks_time19:02:392
9173997559,10cyclictest298-21in:imuxsock19:11:561
9173997550,7cyclictest181rcu_preempt20:40:131
9173997548,9cyclictest181rcu_preempt21:48:071
9173997535,12cyclictest181rcu_preempt23:30:161
9173997535,12cyclictest181rcu_preempt23:30:161
9173997528,17cyclictest0-21swapper/120:42:311
9173997527,25cyclictest9156-21cyclictest20:07:241
916999759,25cyclictest0-21swapper/022:27:090
916999755,33cyclictest13466-21rm22:38:190
9169997525,21cyclictest0-21swapper/022:12:130
9169997525,21cyclictest0-21swapper/022:12:130
9180997459,8cyclictest0-21swapper/221:12:252
9180997457,10cyclictest0-21swapper/223:42:152
9180997457,10cyclictest0-21swapper/223:42:152
9180997441,10cyclictest26647-21ssh23:53:582
9180997441,10cyclictest26647-21ssh23:53:582
9180997438,10cyclictest0-21swapper/220:21:572
9180997415,32cyclictest39-21ksoftirqd/220:52:362
9173997442,14cyclictest181rcu_preempt22:39:141
9173997440,14cyclictest181rcu_preempt21:26:541
916999747,57cyclictest24873-21rm22:03:140
9169997458,10cyclictest26364-21rm23:53:100
9169997458,10cyclictest26364-21rm23:53:100
916999744,24cyclictest16303-21diskmemload21:55:010
916999744,24cyclictest16303-21diskmemload21:55:010
9169997418,26cyclictest8479-21apt-get20:32:100
9180997333,8cyclictest181rcu_preempt21:11:122
9173997351,10cyclictest181rcu_preempt19:27:211
9173997351,10cyclictest181rcu_preempt19:27:211
9173997325,24cyclictest0-21swapper/118:57:161
9169997335,28cyclictest16615-21apt-get20:57:080
9169997318,16cyclictest0-21swapper/020:12:300
9169997315,32cyclictest1950-21kworker/u17:1+xprtiod21:36:560
9169997315,32cyclictest1950-21kworker/u17:1+xprtiod21:36:560
9169997315,24cyclictest799-21taskset23:12:050
9169997315,24cyclictest799-21taskset23:12:050
9169997315,20cyclictest9698-21ssh22:32:250
9169997314,28cyclictest28830-21/usr/sbin/munin23:57:320
9169997313,24cyclictest16303-21diskmemload21:42:230
9169997313,24cyclictest16303-21diskmemload21:42:230
9169997312,26cyclictest15952-21sh21:48:210
9169997311,51cyclictest22138-21sh21:58:560
9169997310,33cyclictest352-21runrttasks19:13:260
9169997310,33cyclictest352-21runrttasks19:13:260
9180997253,10cyclictest0-21swapper/219:33:332
9180997238,11cyclictest181rcu_preempt20:24:562
9180997238,11cyclictest181rcu_preempt20:24:562
9180997236,17cyclictest352-21runrttasks21:01:192
9180997234,12cyclictest58-21kcompactd023:40:582
918099722,34cyclictest617-21grep21:22:352
9173997240,7cyclictest181rcu_preempt20:52:321
916999729,22cyclictest14799-21latency_hist20:51:590
9169997258,8cyclictest19676-21snmpd23:17:150
9169997258,8cyclictest19676-21snmpd23:17:150
9169997255,11cyclictest21397-21apt-config19:32:000
9169997255,11cyclictest21397-21apt-config19:32:000
916999724,35cyclictest0-21swapper/019:02:060
916999724,34cyclictest10338-21fschecks_time23:27:180
916999724,34cyclictest10338-21fschecks_time23:27:180
916999723,41cyclictest24370-21runrttasks23:50:560
9169997216,25cyclictest8198-21cron20:31:550
916999721,54cyclictest14958-21kworker/u17:2+rpciod21:22:210
9169997214,23cyclictest23137-21rm22:55:130
9169997212,27cyclictest1257-21rm22:17:480
918599718,45cyclictest1455-21chrt23:13:283
918599718,45cyclictest1455-21chrt23:13:283
916999714,32cyclictest14598-21modprobe19:11:560
9169997116,28cyclictest7573-21apt-get00:17:090
9169997116,20cyclictest21928-21fschecks_time19:33:230
9169997115,18cyclictest24545-21unin-run19:41:570
9180997046,10cyclictest181rcu_preempt23:24:072
9169997019,21cyclictest29330-21kworker/u17:2+xprtiod00:07:110
9169997019,21cyclictest29330-21kworker/u17:2+xprtiod00:07:110
9169997016,24cyclictest30724-21seq19:58:570
9169997016,24cyclictest30724-21seq19:58:570
9169997015,35cyclictest26393-21/usr/sbin/munin19:47:350
9169997015,26cyclictest28234-21rm22:09:110
9169997013,28cyclictest4336-21ssh22:23:020
9169997013,28cyclictest4336-21ssh22:23:020
9169997012,48cyclictest28006-21/usr/sbin/munin19:52:180
9169997012,48cyclictest28006-21/usr/sbin/munin19:52:180
918599693,54cyclictest11953-21chrt21:42:213
918599693,54cyclictest11953-21chrt21:42:213
9180996922,15cyclictest181rcu_preempt20:16:582
9169996940,20cyclictest12624-21grep20:42:320
9169996915,18cyclictest10074-21/usr/sbin/munin20:37:170
916999691,33cyclictest0-21swapper/023:26:340
9169996913,21cyclictest16462-21/usr/sbin/munin19:17:170
9169996913,21cyclictest16462-21/usr/sbin/munin19:17:170
9169996911,24cyclictest18673-21ssh23:41:530
9169996911,22cyclictest16303-21diskmemload23:09:070
918599684,50cyclictest870-21taskset22:17:313
918599684,48cyclictest23892-21taskset22:56:583
918599683,52cyclictest29026-21taskset19:52:443
918599683,52cyclictest29026-21taskset19:52:443
9180996828,8cyclictest0-21swapper/223:34:192
916999688,24cyclictest1032-21/usr/sbin/munin20:07:280
916999683,29cyclictest0-21swapper/019:02:000
918599673,51cyclictest7223-21taskset00:16:503
918599673,50cyclictest29237-21chrt22:11:563
918599673,50cyclictest22952-21chrt21:07:223
918599672,51cyclictest10234-21chrt21:39:093
918599672,50cyclictest4972-21chrt22:24:483
918599672,50cyclictest4972-21chrt22:24:483
918599664,48cyclictest27688-21taskset19:51:143
918599664,42cyclictest570-21taskset21:22:353
918599663,50cyclictest17854-21taskset23:39:343
918599663,50cyclictest16950-21chrt22:44:423
918599663,49cyclictest9333-21chrt23:25:523
918599663,49cyclictest32225-21taskset20:02:363
918599663,49cyclictest27288-21taskset23:02:173
918599663,48cyclictest32589-21chrt23:11:333
918599663,47cyclictest6562-21chrt21:32:323
918599663,47cyclictest6562-21chrt21:32:323
918599663,47cyclictest29111-21taskset21:17:163
918599662,52cyclictest19642-21taskset22:48:483
918599662,50cyclictest23082-21chrt22:01:343
918599662,50cyclictest19724-21taskset19:27:083
918599662,50cyclictest19724-21taskset19:27:083
918599662,50cyclictest18962-21taskset21:53:243
918599662,50cyclictest18962-21taskset21:53:243
918599662,50cyclictest13341-21taskset22:37:583
918599662,48cyclictest3159-21taskset21:27:253
918599662,48cyclictest19443-21taskset19:26:563
918099664,37cyclictest39-21ksoftirqd/219:22:302
9169996624,10cyclictest0-21swapper/019:42:180
918599653,48cyclictest11178-21chrt19:02:013
918599652,49cyclictest14351-21taskset23:33:063
916999655,25cyclictest0-21swapper/019:22:240
918599643,48cyclictest21187-21chrt21:03:533
918599643,47cyclictest7721-21chrt20:27:323
918599643,47cyclictest19012-21chrt23:42:053
918599643,47cyclictest19012-21chrt23:42:053
918599643,47cyclictest18738-21chrt21:00:253
918599643,47cyclictest17780-21taskset19:21:373
918599643,47cyclictest17780-21taskset19:21:373
918599643,46cyclictest22252-21chrt23:47:163
918599643,46cyclictest1708-21chrt20:11:273
918599642,50cyclictest25069-21taskset23:52:103
918599642,50cyclictest25069-21taskset23:52:103
918599634,46cyclictest22140-21chrt19:33:283
918599633,46cyclictest23687-21chrt19:37:253
918599633,46cyclictest11840-21chrt00:22:583
918599632,47cyclictest4704-21chrt20:18:363
918599632,47cyclictest11112-21chrt20:37:573
87492635,14sleep30-21swapper/318:53:293
918599623,45cyclictest26809-21chrt21:12:333
918599622,50cyclictest6279-21chrt22:27:163
918599622,46cyclictest3072-21chrt20:13:183
918599622,46cyclictest3008-21chrt00:08:233
918599622,46cyclictest3008-21chrt00:08:233
918599622,45cyclictest10609-21taskset19:01:083
9185996211,35cyclictest0-21swapper/323:17:563
9185996211,35cyclictest0-21swapper/323:17:563
918599614,44cyclictest9628-21chrt20:34:323
918599614,44cyclictest14310-21chrt19:08:173
918599613,45cyclictest25252-21chrt19:42:233
918599613,45cyclictest12705-21chrt23:31:523
918599613,45cyclictest12705-21chrt23:31:523
918599613,42cyclictest0-21swapper/320:22:113
918599613,42cyclictest0-21swapper/320:22:113
918599612,46cyclictest30239-21chrt22:12:283
918599612,46cyclictest30239-21chrt22:12:283
918599612,46cyclictest23559-21chrt22:02:113
918599612,46cyclictest15994-21chrt19:14:163
918599612,46cyclictest15994-21chrt19:14:163
918599603,44cyclictest14551-21chrt20:50:243
918599603,44cyclictest12726-21taskset20:43:033
918599602,45cyclictest30987-21taskset00:02:033
918599602,45cyclictest30987-21taskset00:02:033
918599602,45cyclictest30718-21taskset19:58:523
918599602,45cyclictest30718-21taskset19:58:523
918599602,45cyclictest29597-21chrt23:58:513
918599602,44cyclictest16137-21taskset20:55:103
918599592,46cyclictest15878-21chrt21:48:093
918599592,45cyclictest9071-21chrt00:18:373
918599592,45cyclictest10276-21chrt22:32:473
918599583,44cyclictest24031-21chrt22:57:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional