You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 01:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Apr 10, 2026 00:46:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2729210290sleep110-21swapper/1119:07:033
128501020irq/42-ahci0-21swapper/119:08:491
2923210189sleep40-21swapper/419:08:336
9918501000irq/53-eth0-rx-0-21swapper/319:08:355
3173929987sleep90-21swapper/919:05:0211
264129685sleep60-21swapper/619:05:588
991850950irq/53-eth0-rx-0-21swapper/219:07:504
991850880irq/53-eth0-rx-0-21swapper/519:07:227
991850830irq/53-eth0-rx-0-21swapper/1019:06:362
302927772sleep70-21swapper/719:10:009
15050760irq/18-uhci_hcd0-21swapper/819:09:4810
263527262sleep00-21swapper/019:05:520
317299241cyclictest0-21swapper/923:44:0911
3140992214cyclictest0-21swapper/020:24:400
317499203cyclictest991850irq/53-eth0-rx-23:22:362
318299190cyclictest13603-21cstates23:10:113
317499192cyclictest991850irq/53-eth0-rx-23:42:392
317499192cyclictest991850irq/53-eth0-rx-23:27:292
317499192cyclictest991850irq/53-eth0-rx-21:40:412
317499192cyclictest991850irq/53-eth0-rx-00:37:272
317299192cyclictest761ksoftirqd/923:58:5511
317299192cyclictest761ksoftirqd/923:33:0811
317299192cyclictest761ksoftirqd/923:16:0811
317299192cyclictest761ksoftirqd/923:01:3011
317299192cyclictest761ksoftirqd/922:26:3511
317299192cyclictest761ksoftirqd/922:26:3411
317299192cyclictest761ksoftirqd/922:11:1711
317299192cyclictest761ksoftirqd/921:56:4611
317299192cyclictest761ksoftirqd/921:53:5011
317299192cyclictest761ksoftirqd/920:34:5411
317299192cyclictest761ksoftirqd/900:32:1411
317299192cyclictest0-21swapper/923:49:1511
317299192cyclictest0-21swapper/923:28:1611
317299192cyclictest0-21swapper/923:23:3311
317299192cyclictest0-21swapper/923:08:0711
317299192cyclictest0-21swapper/922:55:4011
317299192cyclictest0-21swapper/922:52:4611
317299192cyclictest0-21swapper/922:41:5011
317299192cyclictest0-21swapper/922:39:1011
317299192cyclictest0-21swapper/922:39:0911
317299192cyclictest0-21swapper/922:30:5011
317299192cyclictest0-21swapper/922:21:2011
317299192cyclictest0-21swapper/922:18:2511
317299192cyclictest0-21swapper/922:08:0811
317299192cyclictest0-21swapper/922:01:4811
317299192cyclictest0-21swapper/921:43:3711
317299192cyclictest0-21swapper/921:38:1311
317299192cyclictest0-21swapper/921:32:5911
317299192cyclictest0-21swapper/921:26:2411
317299192cyclictest0-21swapper/921:21:0811
317299192cyclictest0-21swapper/921:17:5911
317299192cyclictest0-21swapper/921:10:4911
317299192cyclictest0-21swapper/921:07:3611
317299192cyclictest0-21swapper/921:00:4511
317299192cyclictest0-21swapper/920:55:4911
317299192cyclictest0-21swapper/920:45:1811
317299192cyclictest0-21swapper/920:40:2811
317299192cyclictest0-21swapper/920:35:1811
317299192cyclictest0-21swapper/920:27:1011
317299192cyclictest0-21swapper/920:23:3811
317299192cyclictest0-21swapper/919:58:2211
317299192cyclictest0-21swapper/919:45:0911
317299192cyclictest0-21swapper/919:38:4811
317299192cyclictest0-21swapper/919:30:4211
317299192cyclictest0-21swapper/919:26:0611
317299192cyclictest0-21swapper/919:22:5911
317299192cyclictest0-21swapper/919:14:2611
317299192cyclictest0-21swapper/900:37:5911
317299192cyclictest0-21swapper/900:23:3411
317299192cyclictest0-21swapper/900:18:0111
317299192cyclictest0-21swapper/900:12:5411
317299192cyclictest0-21swapper/900:05:3111
317299192cyclictest0-21swapper/900:00:4211
314099190cyclictest0-21swapper/022:08:420
3174991817cyclictest5605-21cut22:10:132
3174991817cyclictest0-21swapper/1023:51:262
3174991817cyclictest0-21swapper/1023:36:232
3174991817cyclictest0-21swapper/1021:35:122
3174991817cyclictest0-21swapper/1021:30:242
3174991816cyclictest0-21swapper/1022:27:402
3174991816cyclictest0-21swapper/1022:27:392
317499181cyclictest991950irq/54-eth0-tx-21:53:202
317499181cyclictest991950irq/54-eth0-tx-00:27:262
317499181cyclictest991850irq/53-eth0-rx-23:32:572
317499181cyclictest991850irq/53-eth0-rx-23:11:502
317499181cyclictest991850irq/53-eth0-rx-22:59:132
317499181cyclictest991850irq/53-eth0-rx-22:41:292
317499181cyclictest991850irq/53-eth0-rx-22:33:092
317499181cyclictest991850irq/53-eth0-rx-21:55:362
317499181cyclictest991850irq/53-eth0-rx-21:25:152
317499181cyclictest991850irq/53-eth0-rx-00:31:572
317499181cyclictest991850irq/53-eth0-rx-00:19:152
317499181cyclictest991850irq/53-eth0-rx-00:02:452
317499181cyclictest12850irq/42-ahci22:35:302
317499181cyclictest12850irq/42-ahci22:35:292
317499181cyclictest12850irq/42-ahci21:08:282
317299181cyclictest761ksoftirqd/923:11:5111
317299181cyclictest761ksoftirqd/921:46:1311
317299181cyclictest761ksoftirqd/919:40:1711
317299181cyclictest0-21swapper/923:50:1711
317299181cyclictest0-21swapper/923:36:2911
317299181cyclictest0-21swapper/922:45:4811
317299181cyclictest0-21swapper/922:45:4711
317299181cyclictest0-21swapper/920:50:1811
317299181cyclictest0-21swapper/920:16:0611
317299181cyclictest0-21swapper/920:16:0611
317299181cyclictest0-21swapper/920:10:1011
317299181cyclictest0-21swapper/920:10:0911
317299181cyclictest0-21swapper/920:06:1511
317299181cyclictest0-21swapper/920:00:1611
317299181cyclictest0-21swapper/919:51:0511
317299181cyclictest0-21swapper/919:15:0111
317299181cyclictest0-21swapper/900:25:0711
318299170cyclictest12850irq/42-ahci21:14:443
3174991716cyclictest0-21swapper/1020:05:022
317499170cyclictest991850irq/53-eth0-rx-23:55:092
317499170cyclictest991850irq/53-eth0-rx-23:45:192
317499170cyclictest991850irq/53-eth0-rx-23:15:372
317499170cyclictest991850irq/53-eth0-rx-23:05:142
317499170cyclictest991850irq/53-eth0-rx-22:50:022
317499170cyclictest991850irq/53-eth0-rx-22:45:292
317499170cyclictest991850irq/53-eth0-rx-22:45:282
317499170cyclictest991850irq/53-eth0-rx-22:20:482
317499170cyclictest991850irq/53-eth0-rx-22:15:032
317499170cyclictest991850irq/53-eth0-rx-22:05:062
317499170cyclictest991850irq/53-eth0-rx-22:00:372
317499170cyclictest991850irq/53-eth0-rx-21:45:162
317499170cyclictest991850irq/53-eth0-rx-21:20:402
317499170cyclictest991850irq/53-eth0-rx-21:10:132
317499170cyclictest991850irq/53-eth0-rx-20:40:022
317499170cyclictest991850irq/53-eth0-rx-20:38:512
317499170cyclictest991850irq/53-eth0-rx-20:30:202
317499170cyclictest991850irq/53-eth0-rx-20:20:182
317499170cyclictest991850irq/53-eth0-rx-20:11:322
317499170cyclictest991850irq/53-eth0-rx-20:11:312
317499170cyclictest991850irq/53-eth0-rx-19:36:402
317499170cyclictest991850irq/53-eth0-rx-19:30:182
317499170cyclictest991850irq/53-eth0-rx-19:25:242
317499170cyclictest991850irq/53-eth0-rx-19:10:222
317499170cyclictest991850irq/53-eth0-rx-00:10:002
317499170cyclictest84472sleep1019:59:212
317499170cyclictest41832sleep1023:01:192
317499170cyclictest37182sleep1000:20:282
317499170cyclictest273312sleep1020:25:122
317499170cyclictest220722chrt20:15:222
317499170cyclictest220722chrt20:15:222
317499170cyclictest196422chrt20:55:382
317499170cyclictest16342sleep1019:50:072
317499170cyclictest160372sleep1020:51:022
317499170cyclictest153752chrt00:05:012
317499170cyclictest150092sleep1019:20:402
317499170cyclictest12850irq/42-ahci21:15:152
317499170cyclictest12850irq/42-ahci21:00:132
317499170cyclictest12850irq/42-ahci20:00:212
317499170cyclictest12850irq/42-ahci19:45:142
317499170cyclictest12850irq/42-ahci19:42:122
317499170cyclictest107682sleep1019:15:272
317499170cyclictest103362chrt20:45:132
316699175cyclictest0-21swapper/300:00:005
315299171cyclictest0-21swapper/120:20:201
151170rcuc/00-21swapper/021:05:090
316699163cyclictest0-21swapper/323:14:585
316699163cyclictest0-21swapper/320:05:025
316699161cyclictest30428-21munin-node19:45:195
316699161cyclictest27366-21diskmemload23:31:155
316699161cyclictest27366-21diskmemload21:23:505
316699160cyclictest0-21swapper/323:51:595
316699160cyclictest0-21swapper/323:40:515
316699160cyclictest0-21swapper/323:01:465
316699160cyclictest0-21swapper/322:27:065
316699160cyclictest0-21swapper/322:27:055
316699160cyclictest0-21swapper/322:17:425
316699160cyclictest0-21swapper/321:27:225
316699160cyclictest0-21swapper/320:25:015
316699160cyclictest0-21swapper/319:51:025
316699160cyclictest0-21swapper/319:40:255
316699160cyclictest0-21swapper/319:20:255
316699160cyclictest0-21swapper/300:35:135
316699160cyclictest0-21swapper/300:21:075
316699160cyclictest0-21swapper/300:03:005
315299160cyclictest0-21swapper/119:30:221
667821514sleep110-21swapper/1119:14:053
317099154cyclictest0-21swapper/721:55:009
317099154cyclictest0-21swapper/719:40:569
3169991514cyclictest28998-21python19:40:228
316799151cyclictest0-21swapper/421:54:396
316799150cyclictest31752-21latency_hist21:40:006
316799150cyclictest12082-21ssh23:09:276
316799150cyclictest0-21swapper/423:40:526
316699153cyclictest27366-21diskmemload23:18:315
316699153cyclictest27366-21diskmemload21:12:325
316699152cyclictest0-21swapper/323:20:185
316699152cyclictest0-21swapper/321:17:195
316699152cyclictest0-21swapper/320:20:185
316699150cyclictest27366-21diskmemload23:36:505
316699150cyclictest27366-21diskmemload22:59:105
316699150cyclictest27366-21diskmemload21:39:305
316699150cyclictest27366-21diskmemload21:33:135
316699150cyclictest27366-21diskmemload00:33:165
316699150cyclictest0-21swapper/322:36:465
316699150cyclictest0-21swapper/322:36:455
316699150cyclictest0-21swapper/322:32:245
316699150cyclictest0-21swapper/322:13:215
316699150cyclictest0-21swapper/322:07:275
316699150cyclictest0-21swapper/321:46:255
316699150cyclictest0-21swapper/320:01:495
3171991412cyclictest0-21swapper/800:04:3410
317099145cyclictest0-21swapper/719:25:029
317099144cyclictest0-21swapper/720:20:029
317099143cyclictest0-21swapper/720:10:029
317099143cyclictest0-21swapper/720:10:019
316799145cyclictest0-21swapper/422:48:276
316799145cyclictest0-21swapper/422:48:266
316799140cyclictest0-21swapper/423:54:036
316799140cyclictest0-21swapper/423:45:596
316799140cyclictest0-21swapper/423:19:126
316799140cyclictest0-21swapper/421:48:236
316799140cyclictest0-21swapper/400:20:126
316699144cyclictest0-21swapper/320:34:005
3140991412cyclictest31650-21ssh21:11:470
3140991412cyclictest3136-21gltestperf21:15:160
314099140cyclictest0-21swapper/023:50:440
31140ksoftirqd/00-21swapper/021:25:230
1799140watchdog/10-21swapper/123:56:341
1799140watchdog/10-21swapper/123:54:351
8799130watchdog/110-21swapper/1123:44:393
318299130cyclictest0-21swapper/1122:50:123
317099135cyclictest0-21swapper/723:05:029
317099134cyclictest0-21swapper/723:35:019
317099133cyclictest0-21swapper/723:15:009
317099133cyclictest0-21swapper/723:00:029
317099133cyclictest0-21swapper/722:40:029
317099133cyclictest0-21swapper/722:40:019
317099133cyclictest0-21swapper/722:08:569
317099133cyclictest0-21swapper/719:19:129
316999136cyclictest0-21swapper/623:15:008
316799137cyclictest0-21swapper/423:21:356
316799130cyclictest26291-21ssh22:26:386
316799130cyclictest26291-21ssh22:26:376
316799130cyclictest0-21swapper/423:01:116
316799130cyclictest0-21swapper/422:06:006
316799130cyclictest0-21swapper/421:32:476
316799130cyclictest0-21swapper/420:44:016
316799130cyclictest0-21swapper/400:35:186
316699133cyclictest0-21swapper/321:00:015
316699131cyclictest0-21swapper/320:40:055
316699130cyclictest0-21swapper/323:27:325
316699130cyclictest0-21swapper/322:42:415
316699130cyclictest0-21swapper/321:53:385
316699130cyclictest0-21swapper/300:18:415
314099133cyclictest0-21swapper/023:40:000
314099133cyclictest0-21swapper/023:10:170
31130ksoftirqd/00-21swapper/020:55:080
31130ksoftirqd/00-21swapper/000:25:240
15050130irq/18-uhci_hcd0-21swapper/021:45:240
991850120irq/53-eth0-rx-0-21swapper/000:16:290
4599120watchdog/50-21swapper/519:52:547
3171991211cyclictest691ksoftirqd/820:55:1410
3171991210cyclictest691ksoftirqd/823:05:2710
3171991210cyclictest691ksoftirqd/821:08:2610
317099124cyclictest0-21swapper/720:55:019
317099123cyclictest0-21swapper/723:20:029
317099123cyclictest0-21swapper/721:55:019
317099123cyclictest0-21swapper/720:40:009
317099122cyclictest0-21swapper/721:49:289
317099122cyclictest0-21swapper/720:35:119
317099122cyclictest0-21swapper/719:52:579
316999124cyclictest2875-21qemu-kvm19:11:108
316999124cyclictest0-21swapper/600:25:018
316999123cyclictest0-21swapper/623:55:008
316999120cyclictest0-21swapper/622:14:568
316799128cyclictest0-21swapper/419:15:256
316799127cyclictest0-21swapper/422:41:036
316799126cyclictest0-21swapper/422:36:316
316799126cyclictest0-21swapper/422:36:306
316799124cyclictest0-21swapper/400:30:096
316799122cyclictest2308-21snmpd20:53:286
316799121cyclictest0-21swapper/422:50:246
316799121cyclictest0-21swapper/400:18:086
316799120cyclictest27366-21diskmemload22:30:556
316799120cyclictest15604-21ssh23:38:066
316799120cyclictest11486-21fschecks_count22:15:156
316799120cyclictest0-21swapper/423:56:296
316799120cyclictest0-21swapper/423:30:226
316799120cyclictest0-21swapper/423:25:266
316799120cyclictest0-21swapper/423:12:166
316799120cyclictest0-21swapper/422:55:486
316799120cyclictest0-21swapper/422:00:216
316799120cyclictest0-21swapper/421:55:196
316799120cyclictest0-21swapper/421:28:166
316799120cyclictest0-21swapper/421:09:256
316799120cyclictest0-21swapper/420:58:116
316799120cyclictest0-21swapper/419:55:006
316799120cyclictest0-21swapper/419:45:016
316799120cyclictest0-21swapper/400:25:526
316799120cyclictest0-21swapper/400:10:406
316799120cyclictest0-21swapper/400:05:506
316799120cyclictest0-21swapper/400:01:196
316699128cyclictest0-21swapper/323:45:385
316699128cyclictest0-21swapper/323:05:235
316699128cyclictest0-21swapper/322:20:055
316699128cyclictest0-21swapper/322:01:145
316699128cyclictest0-21swapper/321:56:315
316699128cyclictest0-21swapper/321:40:155
316699128cyclictest0-21swapper/321:05:355
316699128cyclictest0-21swapper/321:00:235
316699128cyclictest0-21swapper/320:52:175
316699128cyclictest0-21swapper/320:45:065
316699128cyclictest0-21swapper/320:35:245
316699128cyclictest0-21swapper/320:16:415
316699128cyclictest0-21swapper/320:16:405
316699128cyclictest0-21swapper/319:55:045
316699128cyclictest0-21swapper/319:25:445
316699128cyclictest0-21swapper/319:15:345
316699128cyclictest0-21swapper/319:10:075
316699128cyclictest0-21swapper/300:10:205
316699128cyclictest0-21swapper/300:05:255
316699122cyclictest0-21swapper/322:50:175
316699122cyclictest0-21swapper/320:10:135
316699122cyclictest0-21swapper/320:10:135
316699122cyclictest0-21swapper/319:35:165
316699121cyclictest0-21swapper/319:30:175
316699120cyclictest0-21swapper/322:45:025
316699120cyclictest0-21swapper/322:45:025
316699120cyclictest0-21swapper/300:25:245
315299122cyclictest0-21swapper/122:45:201
315299122cyclictest0-21swapper/122:45:191
315299122cyclictest0-21swapper/100:10:151
315299120cyclictest0-21swapper/122:16:111
314099128cyclictest0-21swapper/000:30:500
314099124cyclictest0-21swapper/022:15:110
314099123cyclictest0-21swapper/019:25:170
3140991211cyclictest0-21swapper/021:30:240
314099121cyclictest0-21swapper/021:50:470
314099120cyclictest27366-21diskmemload22:25:240
314099120cyclictest27366-21diskmemload22:25:230
314099120cyclictest0-21swapper/023:45:230
314099120cyclictest0-21swapper/022:45:260
314099120cyclictest0-21swapper/022:45:260
314099120cyclictest0-21swapper/022:35:290
314099120cyclictest0-21swapper/022:35:280
31120ksoftirqd/00-21swapper/023:55:130
31120ksoftirqd/00-21swapper/019:35:210
1799120watchdog/10-21swapper/123:00:151
1799120watchdog/10-21swapper/119:40:271
15050120irq/18-uhci_hcd0-21swapper/019:44:550
14050120irq/18-ehci_hcd0-21swapper/021:20:240
901110ksoftirqd/110-21swapper/1121:08:273
551110ksoftirqd/60-21swapper/623:45:508
551110ksoftirqd/60-21swapper/622:40:218
5499110migration/610199-21cstates20:45:128
481110ksoftirqd/527213-21qemu-kvm21:08:277
317199119cyclictest8743-21latency_hist20:00:0110
317199119cyclictest691ksoftirqd/823:41:0110
317199119cyclictest691ksoftirqd/823:34:4110
317199119cyclictest0-21swapper/821:34:2310
317199112cyclictest691ksoftirqd/821:11:4410
317199112cyclictest691ksoftirqd/800:34:5110
3171991110cyclictest691ksoftirqd/823:58:0910
3171991110cyclictest691ksoftirqd/822:29:0810
3171991110cyclictest691ksoftirqd/822:29:0710
3171991110cyclictest691ksoftirqd/821:57:0310
3171991110cyclictest691ksoftirqd/800:24:4210
3171991110cyclictest4976-21snmp_rack3slot919:10:1310
317099115cyclictest0-21swapper/721:35:189
317099113cyclictest0-21swapper/723:53:599
317099113cyclictest0-21swapper/723:40:589
317099113cyclictest0-21swapper/723:11:599
317099113cyclictest0-21swapper/722:54:429
317099113cyclictest0-21swapper/722:44:569
317099113cyclictest0-21swapper/721:33:119
317099113cyclictest0-21swapper/721:18:179
317099113cyclictest0-21swapper/721:10:579
317099113cyclictest0-21swapper/719:34:419
317099113cyclictest0-21swapper/719:24:409
317099113cyclictest0-21swapper/700:39:599
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional