You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 06:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sat Sep 19, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99319910551047,5cyclictest5515-21kworker/3:2+events23:39:533
99319910521049,3cyclictest9900-21kworker/3:0+events23:29:503
99319910521049,2cyclictest1850-21kworker/3:2+events20:35:213
99319910511049,2cyclictest9900-21kworker/3:0+events23:07:133
99319910511048,3cyclictest9900-21kworker/3:0+events23:45:433
99319910511048,3cyclictest23413-21kworker/3:2+events23:50:213
99319910511047,2cyclictest20398-21kworker/3:1+events22:38:193
99279910511049,2cyclictest15559-21kworker/2:1+events22:06:162
99319910501048,2cyclictest30001-21kworker/3:1+events23:13:363
99319910501048,2cyclictest22389-21kworker/3:2+events22:14:423
99319910501048,2cyclictest1850-21kworker/3:2+events21:13:173
99319910501048,2cyclictest12131-21kworker/3:2+events19:23:093
99319910501048,2cyclictest12131-21kworker/3:2+events19:23:093
99319910501047,2cyclictest20438-21kworker/3:2+events22:50:223
99279910501048,2cyclictest27402-21kworker/2:2+events22:16:162
99319910491047,2cyclictest12131-21kworker/3:2+events19:52:343
99319910491046,3cyclictest32188-21kworker/3:1+events19:15:223
99319910491046,3cyclictest1850-21kworker/3:2+events21:00:223
99319910491046,3cyclictest15034-21kworker/3:1+events20:41:593
99279910491048,1cyclictest12292-21kworker/2:0+events22:32:122
99319910481046,2cyclictest30001-21kworker/3:1+events23:03:183
99319910481045,3cyclictest14997-21kworker/3:0+events22:43:513
99319910481044,3cyclictest20438-21kworker/3:2+events22:59:413
99279910481044,2cyclictest15559-21kworker/2:1+events21:34:282
99229910481046,2cyclictest29144-21kworker/1:1+events22:49:041
99319910471045,2cyclictest9900-21kworker/3:0+events23:18:253
99319910471045,2cyclictest5515-21kworker/3:2+events23:40:423
99319910471045,2cyclictest30001-21kworker/3:1+events23:23:323
99319910471045,2cyclictest1850-21kworker/3:2+events20:47:113
99319910471044,3cyclictest19645-21kworker/3:0+events19:34:363
99159910471046,1cyclictest3638-21kworker/0:2+events00:26:050
99319910461044,2cyclictest23983-21kworker/3:1+events19:56:523
99319910461044,2cyclictest20398-21kworker/3:1+events21:05:203
99319910461044,2cyclictest12131-21kworker/3:2+events19:29:463
99279910461044,2cyclictest786-21kworker/2:1+events22:27:112
99159910461044,2cyclictest32217-21kworker/0:1+events21:50:220
99319910451043,2cyclictest5515-21kworker/3:2+events23:30:213
99319910451043,2cyclictest1850-21kworker/3:2+events20:50:223
99319910441042,2cyclictest12131-21kworker/3:2+events19:46:393
99319910431041,2cyclictest23983-21kworker/3:1+events20:00:453
99319910431039,2cyclictest23983-21kworker/3:1+events20:05:243
99279910431041,2cyclictest12834-21kworker/2:2+events22:01:272
99229910431041,2cyclictest31330-21kworker/1:1+events23:59:481
99159910431042,1cyclictest8412-21kworker/0:1+events21:17:330
99159910411039,2cyclictest20232-21kworker/0:2+events21:49:420
99319910401038,2cyclictest20398-21kworker/3:1+events20:55:223
99159910351033,2cyclictest21970-21turbostat19:44:550
99279910341032,2cyclictest21151-21kworker/2:0+events22:23:382
99229910311030,1cyclictest16116-21kworker/1:0+events00:19:131
99159910231022,1cyclictest8288-21kworker/0:2+events00:37:080
99229910221021,1cyclictest16116-21kworker/1:0+events00:13:271
99159910221021,1cyclictest6863-21kworker/0:0+events21:21:500
99229910161016,0cyclictest31330-21kworker/1:1+events00:03:431
99229910081006,2cyclictest7480-21turbostat21:59:561
99159910081004,4cyclictest22769-21turbostat21:04:550
99229910021000,2cyclictest31330-21kworker/1:1+events00:09:361
9922991000999,1cyclictest29144-21kworker/1:1+events19:11:051
992299997995,2cyclictest6091-21turbostat00:39:551
991599995995,0cyclictest20232-21kworker/0:2+events21:43:280
992299994993,1cyclictest16116-21kworker/1:0+events00:22:331
991599991990,1cyclictest20232-21kworker/0:2+events21:59:360
991599991988,3cyclictest23579-21turbostat00:24:550
991599984983,1cyclictest3200-21kworker/0:0+events00:30:550
993199980977,3cyclictest10052-21turbostat22:34:553
991599980979,1cyclictest6863-21kworker/0:0+events21:27:550
991599976975,1cyclictest2391-21kworker/0:2+events20:19:450
991599975974,1cyclictest8412-21kworker/0:1+events20:34:120
991599973972,1cyclictest20345-21kworker/0:0+events20:21:490
991599969968,1cyclictest8412-21kworker/0:1+events20:29:340
991599969968,1cyclictest6863-21kworker/0:0+events21:38:000
991599969968,1cyclictest2391-21kworker/0:2+events20:11:170
991599969968,1cyclictest20189-21kworker/0:2+events19:37:570
993199950948,2cyclictest8618-21turbostat20:29:543
991599950948,2cyclictest9800-21turbostat19:14:550
991599946943,3cyclictest2680-21turbostat22:59:550
991599944942,2cyclictest18546-21turbostat00:19:550
992299943941,2cyclictest9873-21turbostat21:29:541
992299909908,1cyclictest22457-21turbostat22:14:561
993199899897,2cyclictest29891-21turbostat21:49:553
991599895893,2cyclictest25102-21turbostat22:49:560
991599894892,2cyclictest28066-21turbostat23:24:560
993199892890,2cyclictest8595-21turbostat00:09:563
993199892890,2cyclictest14894-21turbostat21:34:553
992299882879,3cyclictest10642-21turbostat20:34:541
991599871869,2cyclictest17481-21turbostat22:09:550
993199694691,3cyclictest10642-21turbostat20:34:543
993199679676,3cyclictest21970-21turbostat19:44:553
992799647646,1cyclictest7480-21turbostat21:59:552
991599634631,3cyclictest17935-21turbostat19:34:550
993199610607,3cyclictest6091-21turbostat00:39:553
993199594591,3cyclictest9800-21turbostat19:14:553
992299585581,4cyclictest20075-21turbostat22:44:561
992799583581,2cyclictest9873-21turbostat21:29:542
991599557556,1cyclictest14894-21turbostat21:34:540
992799550548,2cyclictest22457-21turbostat22:14:562
993199540536,4cyclictest25102-21turbostat22:49:553
991599535533,2cyclictest32520-21turbostat20:09:550
993199514511,3cyclictest17481-21turbostat22:09:563
992299501500,1cyclictest25986-21turbostat23:54:561
991599497494,3cyclictest26815-21turbostat21:14:540
9922991918,1cyclictest67750irq/123-lan23:45:101
9922991918,1cyclictest67750irq/123-lan00:25:161
9922991818,0cyclictest67750irq/123-lan23:05:341
9922991818,0cyclictest67750irq/123-lan23:00:151
9922991818,0cyclictest67750irq/123-lan22:21:261
9922991818,0cyclictest67750irq/123-lan21:30:101
9922991818,0cyclictest67750irq/123-lan21:05:231
9922991818,0cyclictest67750irq/123-lan20:35:211
9922991817,1cyclictest67750irq/123-lan22:05:141
9922991817,1cyclictest67750irq/123-lan22:01:371
9922991817,1cyclictest67750irq/123-lan00:30:171
9922991717,0cyclictest67750irq/123-lan23:42:351
9922991717,0cyclictest67750irq/123-lan23:31:541
9922991717,0cyclictest67750irq/123-lan23:10:171
9922991717,0cyclictest67750irq/123-lan22:59:101
9922991717,0cyclictest67750irq/123-lan22:50:401
9922991717,0cyclictest67750irq/123-lan22:31:451
9922991717,0cyclictest67750irq/123-lan22:17:051
9922991717,0cyclictest67750irq/123-lan21:50:211
9922991717,0cyclictest67750irq/123-lan21:46:141
9922991717,0cyclictest67750irq/123-lan21:20:581
9922991717,0cyclictest67750irq/123-lan21:16:271
9922991717,0cyclictest67750irq/123-lan21:11:011
9922991717,0cyclictest67750irq/123-lan20:55:001
9922991717,0cyclictest67750irq/123-lan20:00:421
9922991717,0cyclictest67750irq/123-lan19:30:181
9922991716,1cyclictest67750irq/123-lan23:29:321
9922991716,1cyclictest67750irq/123-lan22:26:431
9922991716,1cyclictest67750irq/123-lan21:39:091
9922991716,1cyclictest67750irq/123-lan19:50:121
9922991716,1cyclictest67750irq/123-lan19:39:551
9922991716,1cyclictest29144-21kworker/1:1+events20:16:041
9922991616,0cyclictest67750irq/123-lan23:35:111
9922991616,0cyclictest67750irq/123-lan23:19:081
9922991616,0cyclictest67750irq/123-lan21:44:351
9922991616,0cyclictest67750irq/123-lan21:00:201
9922991616,0cyclictest67750irq/123-lan20:40:121
9922991615,1cyclictest67750irq/123-lan23:20:201
9922991515,0cyclictest784-21snmpd19:41:231
9922991515,0cyclictest67750irq/123-lan22:35:411
9922991515,0cyclictest67750irq/123-lan20:45:301
9922991515,0cyclictest67750irq/123-lan19:59:401
9922991414,0cyclictest67750irq/123-lan19:25:471
9922991413,1cyclictest67750irq/123-lan20:25:101
9922991413,1cyclictest67750irq/123-lan20:10:171
9931991313,0cyclictest9900-21kworker/3:0+events_freezable00:27:233
9922991313,0cyclictest784-21snmpd20:21:071
9922991313,0cyclictest67750irq/123-lan20:05:161
9922991312,1cyclictest67750irq/123-lan19:45:121
9922991212,0cyclictest67750irq/123-lan19:20:151
9922991212,0cyclictest67750irq/123-lan19:20:151
992299109,1cyclictest67750irq/123-lan19:15:151
9922991010,0cyclictest67750irq/123-lan20:50:171
99279998,1cyclictest784-21snmpd21:01:092
99279998,1cyclictest784-21snmpd19:24:352
99279998,1cyclictest784-21snmpd19:24:352
99279998,1cyclictest24000-21idleruntime-cro19:45:002
99159998,1cyclictest784-21snmpd20:42:040
99159998,1cyclictest782-21lldpd20:55:280
99319988,0cyclictest784-21snmpd22:25:543
99319988,0cyclictest784-21snmpd22:23:103
99319987,1cyclictest784-21snmpd19:39:233
99279988,0cyclictest784-21snmpd00:00:562
99279988,0cyclictest782-21lldpd23:57:422
99279988,0cyclictest782-21lldpd23:06:402
99279988,0cyclictest782-21lldpd20:53:562
99279987,1cyclictest782-21lldpd19:46:472
99279987,1cyclictest526-21avahi-daemon22:52:022
99279987,1cyclictest526-21avahi-daemon22:37:442
99279987,1cyclictest526-21avahi-daemon00:31:082
99279986,2cyclictest784-21snmpd23:45:132
99279986,2cyclictest784-21snmpd22:41:092
99159988,0cyclictest784-21snmpd23:42:550
99159988,0cyclictest784-21snmpd19:26:080
99159988,0cyclictest784-21snmpd19:22:030
99159988,0cyclictest784-21snmpd19:22:020
99159988,0cyclictest782-21lldpd19:45:170
99159986,2cyclictest784-21snmpd20:04:300
99159986,2cyclictest784-21snmpd00:01:260
99159986,2cyclictest762-21ntpd23:31:010
99159986,2cyclictest762-21ntpd22:42:500
99159986,2cyclictest762-21ntpd22:02:280
99159986,2cyclictest17406-21cat20:45:150
99319977,0cyclictest784-21snmpd21:29:123
99319977,0cyclictest782-21lldpd21:50:283
99319977,0cyclictest507-21systemd-resolve21:18:123
99319977,0cyclictest207-21jbd2/nvme0n1p2-823:57:253
99319976,1cyclictest9909-21cyclictest22:02:163
99319976,1cyclictest784-21snmpd20:12:423
99319976,1cyclictest5550-21ntp_kernel_err20:15:153
99319976,1cyclictest526-21avahi-daemon22:19:203
99319976,1cyclictest526-21avahi-daemon00:17:023
99279977,0cyclictest784-21snmpd20:15:482
99279977,0cyclictest782-21lldpd23:30:572
99279977,0cyclictest782-21lldpd19:25:542
99279976,1cyclictest784-21snmpd23:18:222
99279976,1cyclictest784-21snmpd21:41:122
99279976,1cyclictest784-21snmpd20:05:072
99279976,1cyclictest782-21lldpd20:27:082
99279976,1cyclictest507-21systemd-resolve21:45:152
99279976,1cyclictest25638-21fschecks_count22:45:122
99279975,2cyclictest784-21snmpd19:56:182
99279975,2cyclictest784-21snmpd19:32:392
99279975,2cyclictest784-21snmpd00:20:232
99279975,2cyclictest10555-21cat19:10:132
99159977,0cyclictest784-21snmpd23:35:230
99159977,0cyclictest782-21lldpd19:57:510
99159976,1cyclictest526-21avahi-daemon23:58:100
99159975,2cyclictest762-21ntpd22:11:050
99159975,2cyclictest13355-21cat20:35:140
99159974,2cyclictest64-21kcompactd023:50:170
99159972,5cyclictest547-21NetworkManager19:54:530
99319963,3cyclictest14819-21ntp_states00:10:173
99319962,4cyclictest1850-21kworker/3:2-events20:23:593
99279966,0cyclictest784-21snmpd23:41:192
99279966,0cyclictest784-21snmpd23:02:102
99279966,0cyclictest784-21snmpd21:10:142
99279966,0cyclictest782-21lldpd19:54:352
99279966,0cyclictest507-21systemd-resolve21:50:272
99279965,1cyclictest784-21snmpd23:53:302
99279965,1cyclictest784-21snmpd20:36:192
99279965,1cyclictest421ktimers/223:14:572
99279964,2cyclictest784-21snmpd00:36:182
99279963,2cyclictest29236-21ssh23:20:182
99279963,2cyclictest22396-21ssh21:36:232
99279963,2cyclictest11544-21ssh00:07:032
99279962,3cyclictest5965-21cut21:20:142
99279962,3cyclictest13680-21ssh23:36:352
99159966,0cyclictest784-21snmpd23:45:250
99159966,0cyclictest784-21snmpd23:16:000
99159966,0cyclictest782-21lldpd23:13:510
99159966,0cyclictest782-21lldpd22:27:320
99159966,0cyclictest507-21systemd-resolve23:00:240
99159965,1cyclictest526-21avahi-daemon00:13:110
99159962,3cyclictest2589-21sh23:25:300
99159962,3cyclictest12982-21ssh22:31:570
99159962,3cyclictest12923-21ld19:15:160
99319954,1cyclictest20438-21df_inode21:35:143
99319953,2cyclictest26613-21grep21:40:203
99319952,3cyclictest24285-21grep00:20:133
99319952,2cyclictest9729-21ssh21:55:593
99319952,2cyclictest8743-21ssh21:23:193
99319952,2cyclictest5298-21unixbench-2d00:00:193
99319952,2cyclictest2817-21unixbench-2d00:30:203
99279955,0cyclictest784-21snmpd20:40:142
99279955,0cyclictest784-21snmpd20:21:252
99279955,0cyclictest526-21avahi-daemon20:31:102
99279954,1cyclictest507-21systemd-resolve19:16:082
99279954,1cyclictest17813-21ntpq20:45:172
99279954,1cyclictest0-21swapper/220:10:182
99279953,2cyclictest784-21snmpd20:58:142
99279953,2cyclictest784-21snmpd00:15:142
99279952,2cyclictest797-21ls21:15:142
99279952,2cyclictest4738-21rm22:55:412
99279952,2cyclictest30186-21sed00:25:212
99279952,2cyclictest1814-21ssh23:25:162
99159954,1cyclictest171ktimers/000:05:360
99159953,2cyclictest784-21snmpd21:08:410
99159953,2cyclictest762-21ntpd22:21:120
99159952,2cyclictest30240-21ssh22:16:430
99159952,2cyclictest15393-21ssh22:35:090
99159951,3cyclictest30780-21expr22:50:120
99159951,3cyclictest14837-21awk23:05:210
99279944,0cyclictest526-21avahi-daemon19:35:102
99279943,1cyclictest784-21snmpd20:00:482
99279941,2cyclictest245-20systemd-journal21:05:432
99279940,4cyclictest14770-21ntpq00:10:172
99159941,2cyclictest19815-21ldconfig20:50:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional