You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 23, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
491823524,0sleep00-21swapper/006:48:500
304450350,0irq/25-eth10-21swapper/306:46:563
484623324,0sleep20-21swapper/206:47:592
494122622,0sleep10-21swapper/106:49:071
52499970,0cyclictest19566-21ssh12:02:051
339970,0migration/310110-21sh10:33:473
52509966,0cyclictest3212-21diskmemload10:32:552
52509966,0cyclictest3212-21diskmemload10:24:252
52489966,0cyclictest0-21swapper/009:40:170
52489965,0cyclictest0-21swapper/010:52:110
339960,0migration/39522-21sh11:12:533
339960,0migration/327358-21sh09:06:183
339960,0migration/327089-21taskset09:45:113
339960,0migration/318691-21sh11:00:453
339960,0migration/318296-21sh11:40:203
339960,0migration/31771-21munin-node08:22:143
339960,0migration/313506-21latency08:07:103
339960,0migration/311145-21sh11:16:543
29725060,0irq/27-eth0-tx-3487-21munin-node08:52:030
29725060,0irq/27-eth0-tx-18799-21munin-node07:02:100
29725060,0irq/27-eth0-tx-14934-21munin-node08:12:020
29715060,0irq/26-eth0-rx-4176-21entropy09:12:033
29715060,0irq/26-eth0-rx-28475-21perl10:07:053
29715060,0irq/26-eth0-rx-28225-21grep10:47:023
29715060,0irq/26-eth0-rx-24569-21cut11:02:073
29715060,0irq/26-eth0-rx-16129-21ls12:17:083
29715060,0irq/26-eth0-rx-12110-21df09:57:043
149960,0migration/02843-21sh09:10:260
149960,0migration/027190-21sh11:26:510
149960,0migration/017335-21taskset11:57:530
149960,0migration/010512-21sh11:56:290
8215050,0irq/24-0000:00:18852-21idleruntime-cro11:41:502
8215050,0irq/24-0000:00:11108-21munin-run08:56:512
52509955,0cyclictest0-21swapper/209:42:002
52509955,0cyclictest0-21swapper/209:12:502
52509955,0cyclictest0-21swapper/208:37:032
52509950,0cyclictest0-21swapper/210:00:272
52509950,0cyclictest0-21swapper/207:37:182
52499955,0cyclictest0-21swapper/110:28:171
52499950,0cyclictest0-21swapper/110:01:291
339950,0migration/35870-21kthreadcore10:12:073
339950,0migration/35487-21kthreadcore08:52:083
339950,0migration/33182-21fschecks_count12:12:033
339950,0migration/330303-21kthreadcore07:32:093
339950,0migration/328368-21munin-node11:47:073
339950,0migration/327870-21taskset08:20:233
339950,0migration/325935-21munin-node10:02:153
339950,0migration/325071-21taskset07:05:153
339950,0migration/322236-21taskset08:41:363
339950,0migration/322144-21kthreadcore07:27:083
339950,0migration/32213-21runrttasks09:08:473
339950,0migration/321480-21latency_hist08:16:513
339950,0migration/312219-21idleruntime08:57:053
339950,0migration/310234-21taskset11:55:433
29725050,0irq/27-eth0-tx-546-21munin-node07:37:020
29725050,0irq/27-eth0-tx-3212-21diskmemload11:02:062
29725050,0irq/27-eth0-tx-3051-21munin-node11:12:022
29725050,0irq/27-eth0-tx-27829-21munin-node10:07:082
29725050,0irq/27-eth0-tx-26675-21chrt11:26:012
29725050,0irq/27-eth0-tx-25241-21vmstat11:42:142
29725050,0irq/27-eth0-tx-1863-21ssh09:47:412
29725050,0irq/27-eth0-tx-16912-21netstat08:57:102
29725050,0irq/27-eth0-tx-12294-21munin-node09:17:032
29725050,0irq/27-eth0-tx-11444-21aten_r1power_po10:57:012
29725050,0irq/27-eth0-tx-11177-21munin-node11:17:122
29725050,0irq/27-eth0-tx-1070-21ssh11:47:452
29725050,0irq/27-eth0-tx-0-21swapper/211:52:032
29725050,0irq/27-eth0-tx-0-21swapper/211:08:252
29725050,0irq/27-eth0-tx-0-21swapper/210:52:092
29725050,0irq/27-eth0-tx-0-21swapper/210:29:082
29725050,0irq/27-eth0-tx-0-21swapper/210:04:582
29725050,0irq/27-eth0-tx-0-21swapper/209:32:452
29725050,0irq/27-eth0-tx-0-21swapper/209:27:132
29725050,0irq/27-eth0-tx-0-21swapper/007:58:450
29715050,0irq/26-eth0-rx-6559-21runrttasks10:51:543
29715050,0irq/26-eth0-rx-4216-21grep09:52:043
29715050,0irq/26-eth0-rx-27768-21ssh10:27:033
29715050,0irq/26-eth0-rx-26727-21ssh09:23:453
29715050,0irq/26-eth0-rx-2566-21ssh09:49:413
29715050,0irq/26-eth0-rx-23570-21kthreadcore12:02:103
29715050,0irq/26-eth0-rx-18837-21grep12:01:503
29715050,0irq/26-eth0-rx-18775-21ssh09:18:593
29715050,0irq/26-eth0-rx-12515-21if_eth010:17:063
29715050,0irq/26-eth0-rx-0-21swapper/312:10:383
29715050,0irq/26-eth0-rx-0-21swapper/311:42:073
29715050,0irq/26-eth0-rx-0-21swapper/311:34:093
29715050,0irq/26-eth0-rx-0-21swapper/311:23:343
29715050,0irq/26-eth0-rx-0-21swapper/311:11:043
29715050,0irq/26-eth0-rx-0-21swapper/310:37:023
29715050,0irq/26-eth0-rx-0-21swapper/310:37:023
29715050,0irq/26-eth0-rx-0-21swapper/309:39:483
29715050,0irq/26-eth0-rx-0-21swapper/309:29:063
259950,0migration/27262-21latency_hist07:41:512
259950,0migration/23259-21sh09:11:232
259950,0migration/23129-21kthreadcore07:12:082
259950,0migration/230473-21kthreadcore10:47:052
259950,0migration/22584-21timerwakeupswit08:47:112
249950,0watchdog/217226-21python10:37:132
249950,0watchdog/217226-21python10:37:132
179950,0migration/16629-21kthreadcore09:32:081
179950,0migration/130175-21kthreadcore09:07:081
179950,0migration/125490-21munin-node09:42:111
179950,0migration/120068-21munin-node09:22:011
179950,0migration/117676-21sh11:18:151
179950,0migration/116734-21sendmail_mailtr11:57:111
149950,0migration/08120-21kthreadcore11:12:070
149950,0migration/06072-21kthreadcore12:12:070
149950,0migration/05022-21kthreadcore10:32:070
149950,0migration/032398-21kthreadcore10:47:060
149950,0migration/032065-21kthreadcore08:22:080
149950,0migration/029027-21kthreadcore07:32:080
149950,0migration/026534-21kthreadcore08:42:060
149950,0migration/026406-21munin-node07:07:060
149950,0migration/026002-21missed_timers07:52:090
149950,0migration/02484-21sh11:51:460
149950,0migration/023779-21kthreadcore11:42:080
149950,0migration/023771-21kthreadcore07:27:080
149950,0migration/022165-21kthreadcore11:02:060
149950,0migration/019122-21sh09:01:200
149950,0migration/01827-21taskset10:08:000
149950,0migration/017312-21kthreadcore08:37:060
149950,0migration/01571-21sh11:08:290
149950,0migration/015292-21kthreadcore07:22:080
149950,0migration/013427-21kthreadcore10:57:060
149950,0migration/011891-21munin-node09:57:030
149950,0migration/011640-21fschecks_time11:37:010
149950,0migration/011250-21aten_r1power_fr11:17:010
149950,0migration/010801-21kthreadcore07:42:080
149950,0migration/010033-21taskset09:52:420
52509943,0cyclictest7355-21awk07:17:062
52509943,0cyclictest3514-21snmpd08:32:072
52509943,0cyclictest3514-21snmpd08:03:222
52509943,0cyclictest3514-21snmpd06:51:532
52509943,0cyclictest3485-21awk08:27:072
52509943,0cyclictest28290-21awk07:57:072
52509943,0cyclictest27998-21awk12:07:052
52509943,0cyclictest15865-21awk08:12:052
52509943,0cyclictest12992-21awk06:57:062
52499944,0cyclictest0-21swapper/111:45:321
52499943,0cyclictest3764-21awk11:52:061
52499943,0cyclictest3556-21lldpd12:08:571
52499943,0cyclictest3556-21lldpd11:27:271
52499943,0cyclictest3556-21lldpd08:52:261
52499943,0cyclictest3556-21lldpd08:39:571
52499943,0cyclictest3556-21lldpd07:01:551
52499943,0cyclictest3556-21lldpd06:56:551
52499943,0cyclictest3514-21snmpd10:48:381
52499943,0cyclictest3514-21snmpd08:05:071
52499943,0cyclictest28159-21awk11:47:061
52499943,0cyclictest20567-21awk07:27:061
52499943,0cyclictest1481-21awk07:37:061
52499943,0cyclictest12368-21awk10:37:051
52499943,0cyclictest12368-21awk10:37:051
52499943,0cyclictest10121-21awk08:32:051
52489944,0cyclictest0-21swapper/009:27:500
52489943,0cyclictest4694-21awk09:32:060
52489943,0cyclictest4640-21awk09:12:050
52489943,0cyclictest4485-21awk10:12:060
52489943,0cyclictest3514-21snmpd10:23:230
52489943,0cyclictest3514-21snmpd08:19:220
52489943,0cyclictest3514-21snmpd06:55:080
52489943,0cyclictest12368-21grep10:17:040
52489940,0cyclictest29190-21munin-node08:47:060
339940,0migration/38211-21kthreadcore07:17:073
339940,0migration/37035-21taskset07:41:133
339940,0migration/35501-21kthreadcore08:27:093
339940,0migration/328352-21irqcore07:57:073
339940,0migration/327333-21kthreadcore08:42:063
339940,0migration/319391-21latency_hist10:41:513
339940,0migration/316268-21kthreadcore06:57:093
29725040,0irq/27-eth0-tx-19842-21cpuspeed_turbos09:02:022
29725040,0irq/27-eth0-tx-11830-21munin-node09:37:122
29725040,0irq/27-eth0-tx-10882-21ssh11:56:542
29725040,0irq/27-eth0-tx-10745-21munin-node12:17:062
29725040,0irq/27-eth0-tx-10374-21ssh12:16:352
29725040,0irq/27-eth0-tx-0-21swapper/211:32:132
29725040,0irq/27-eth0-tx-0-21swapper/210:16:572
29725040,0irq/27-eth0-tx-0-21swapper/209:53:492
29725040,0irq/27-eth0-tx-0-21swapper/008:32:130
29725040,0irq/27-eth0-tx-0-21swapper/008:28:510
29725040,0irq/27-eth0-tx-0-21swapper/007:47:030
29715040,0irq/26-eth0-rx-0-21swapper/311:27:083
29715040,0irq/26-eth0-rx-0-21swapper/310:22:123
29715040,0irq/26-eth0-rx-0-21swapper/309:31:583
29715040,0irq/26-eth0-rx-0-21swapper/308:32:013
29715040,0irq/26-eth0-rx-0-21swapper/307:12:023
29715040,0irq/26-eth0-rx-0-21swapper/306:52:093
259940,0migration/228979-21kthreadcore07:32:082
259940,0migration/226012-21missed_timers07:52:092
259940,0migration/224801-21kthreadcore10:42:092
259940,0migration/222892-21df_inode08:42:012
259940,0migration/221464-21kthreadcore12:02:092
259940,0migration/220762-21fschecks_time09:22:042
259940,0migration/218999-21kthreadcore07:47:082
259940,0migration/218873-21aten_r1power_fr07:02:012
259940,0migration/217666-21kthreadcore07:22:082
259940,0migration/212171-21kthreadcore08:07:092
249940,0watchdog/210284-21ssh10:13:532
249940,0watchdog/20-21swapper/211:27:082
19140,0ktimersoftd/10-21swapper/109:54:141
179940,0migration/17472-21kthreadcore06:52:081
179940,0migration/1547-21runrttasks08:22:081
179940,0migration/14725-21kthreadcore11:12:061
179940,0migration/13590-21latency_hist09:31:511
179940,0migration/13404-21fschecks_count11:32:031
179940,0migration/129315-21kthreadcore07:32:091
179940,0migration/127584-21kthreadcore07:07:071
179940,0migration/125406-21kthreadcore08:17:091
179940,0migration/124267-21kthreadcore10:42:081
179940,0migration/12424-21latency_hist08:26:511
179940,0migration/123403-21kthreadcore07:52:081
179940,0migration/122181-21kthreadcore09:02:071
179940,0migration/122024-21kthreadcore11:22:061
179940,0migration/116700-21kthreadcore08:12:061
179940,0migration/116694-21kthreadcore07:47:081
179940,0migration/116550-21switchtime12:17:121
179940,0migration/114038-21kthreadcore09:37:071
179940,0migration/112588-21kthreadcore11:37:051
179940,0migration/112241-21fschecks_time10:17:031
169940,0watchdog/19368-21ssh10:12:131
169940,0watchdog/14693-21awk09:12:051
169940,0watchdog/14664-21cat10:52:091
169940,0watchdog/131962-21cut10:07:091
169940,0watchdog/12665-21ssh09:49:571
169940,0watchdog/117838-21switchtime09:17:131
169940,0watchdog/10-21swapper/112:12:001
169940,0watchdog/10-21swapper/108:58:411
149940,0migration/07179-21kthreadcore11:32:070
149940,0migration/04209-21kthreadcore07:12:080
149940,0migration/03786-21kthreadcore08:02:070
149940,0migration/026043-21sh12:04:450
149940,0migration/022446-21kthreadcore09:22:070
149940,0migration/022033-21kthreadcore09:42:070
149940,0migration/017915-21runrttasks10:38:110
149940,0migration/017915-21runrttasks10:38:110
149940,0migration/013404-21kthreadcore08:07:100
149940,0migration/013197-21irqcore09:17:060
52509932,0cyclictest26407-21awk07:07:062
52509932,0cyclictest21626-21basename08:17:032
52509931,0cyclictest29133-21if_eth008:22:052
52499933,0cyclictest3556-21lldpd10:21:571
52499932,0cyclictest9286-21awk08:07:071
52499932,0cyclictest8293-21awk07:42:061
52499932,0cyclictest28266-21awk07:57:061
52499932,0cyclictest25424-21head10:02:111
52499932,0cyclictest20088-21gltestperf11:02:021
52499930,0cyclictest13498-21diskstats07:22:031
52489933,0cyclictest4468-21kworker/0:112:16:550
52489933,0cyclictest4468-21kworker/0:112:07:010
52489933,0cyclictest4468-21kworker/0:110:41:540
52489933,0cyclictest4468-21kworker/0:110:27:080
52489933,0cyclictest4468-21kworker/0:110:01:560
52489933,0cyclictest4468-21kworker/0:109:01:520
52489933,0cyclictest4468-21kworker/0:107:17:010
52489933,0cyclictest4468-21kworker/0:106:56:570
52489932,0cyclictest24981-21sensors11:22:110
52489930,0cyclictest28368-21munin-node09:47:030
29715030,0irq/26-eth0-rx-0-21swapper/308:47:003
29715030,0irq/26-eth0-rx-0-21swapper/308:05:083
29715030,0irq/26-eth0-rx-0-21swapper/307:52:113
29715030,0irq/26-eth0-rx-0-21swapper/307:48:283
29715030,0irq/26-eth0-rx-0-21swapper/307:42:283
29715030,0irq/26-eth0-rx-0-21swapper/307:21:583
27130,0ktimersoftd/20-21swapper/207:31:142
179930,0migration/14639-21kthreadcore07:12:091
169930,0watchdog/13212-21diskmemload10:32:011
169930,0watchdog/10-21swapper/111:07:051
169930,0watchdog/10-21swapper/110:56:531
169930,0watchdog/10-21swapper/108:47:091
169930,0watchdog/10-21swapper/108:42:011
169930,0watchdog/10-21swapper/107:17:011
29715020,0irq/26-eth0-rx-0-21swapper/307:07:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional