You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 23:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue May 12, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2466199260,25cyclictest0-21swapper/210:39:072
2466499250,0cyclictest0-21swapper/309:56:293
2466199250,24cyclictest0-21swapper/211:41:432
2466199250,24cyclictest0-21swapper/211:17:222
2466199250,0cyclictest0-21swapper/212:19:032
24657992524,1cyclictest14797-21ssh10:31:201
24657992523,1cyclictest3477-21ssh12:13:021
24657992523,1cyclictest3477-21ssh12:13:021
24657992523,1cyclictest25795-21df_inode11:36:591
2465799250,24cyclictest0-21swapper/112:09:511
2465799250,24cyclictest0-21swapper/110:11:111
2465399250,24cyclictest19582-21diskmemload11:31:120
2465399250,21cyclictest606-21dbus-daemon12:20:010
24664992421,2cyclictest19195-21if_enp1s012:27:003
2466499240,24cyclictest0-21swapper/309:37:583
2466499240,23cyclictest26787-21perf08:20:013
2466499240,23cyclictest22970-21ssh09:41:473
2466499240,23cyclictest19582-21diskmemload12:37:043
2466499240,23cyclictest19582-21diskmemload09:49:323
2466499240,23cyclictest19019-21sh10:34:433
2466499240,1cyclictest2400-21ssh10:20:073
2466499240,0cyclictest0-21swapper/310:35:433
24661992423,1cyclictest0-21swapper/210:13:532
24661992422,2cyclictest0-21swapper/209:28:192
24661992422,1cyclictest0-21swapper/209:40:332
2466199240,23cyclictest13380-21ssh11:53:482
2466199240,1cyclictest20806-21ssh09:39:072
2466199240,0cyclictest0-21swapper/210:49:062
24657992423,1cyclictest19582-21diskmemload11:13:271
24657992422,1cyclictest0-21swapper/110:50:021
2465799242,1cyclictest0-21swapper/111:30:111
2465799241,22cyclictest0-21swapper/109:31:571
2465799240,24cyclictest0-21swapper/112:30:031
2465799240,24cyclictest0-21swapper/112:00:061
2465799240,23cyclictest21956-21basename08:10:001
2465799240,23cyclictest19582-21diskmemload09:22:501
2465799240,23cyclictest0-21swapper/110:42:451
2465799240,23cyclictest0-21swapper/110:27:131
2465799240,23cyclictest0-21swapper/110:16:241
2465799240,23cyclictest0-21swapper/109:27:351
2465799240,0cyclictest19582-21diskmemload11:55:511
2465799240,0cyclictest0-21swapper/112:23:041
24653992422,1cyclictest0-21swapper/010:47:010
2465399240,24cyclictest0-21swapper/008:45:020
2465399240,23cyclictest6151-21munin-run11:20:000
2465399240,23cyclictest0-21swapper/011:49:280
2465399240,23cyclictest0-21swapper/010:36:130
2465399240,23cyclictest0-21swapper/010:08:340
2465399240,0cyclictest0-21swapper/010:16:420
2465399240,0cyclictest0-21swapper/009:35:350
24664992323,0cyclictest0-21swapper/311:55:493
24664992323,0cyclictest0-21swapper/311:45:173
24664992323,0cyclictest0-21swapper/311:34:363
24664992323,0cyclictest0-21swapper/310:47:593
24664992322,1cyclictest22585-21ssh10:09:223
24664992322,1cyclictest19582-21diskmemload12:12:583
24664992322,1cyclictest19582-21diskmemload12:12:583
24664992320,2cyclictest1792-21sh11:43:583
24664992320,2cyclictest13711-21sh09:32:113
2466499231,21cyclictest0-21swapper/312:00:423
2466499231,1cyclictest11332-21ssh12:20:023
2466499230,2cyclictest6431-21ssh12:16:423
2466499230,2cyclictest29568-21ssh10:15:403
2466499230,2cyclictest12149-21ssh11:25:083
2466499230,23cyclictest0-21swapper/312:35:003
2466499230,23cyclictest0-21swapper/310:52:313
2466499230,23cyclictest0-21swapper/309:12:313
2466499230,22cyclictest2807-21apt-get08:36:563
2466499230,22cyclictest27153-21unixbench_singl11:37:073
2466499230,22cyclictest19582-21diskmemload11:21:173
2466499230,22cyclictest1240-21ssh09:50:513
2466499230,22cyclictest0-21swapper/311:11:533
2466499230,1cyclictest30132-21ssh09:18:513
2466499230,0cyclictest19582-21diskmemload12:09:433
2466499230,0cyclictest19582-21diskmemload10:40:053
2466499230,0cyclictest0-21swapper/311:16:003
24661992323,0cyclictest19582-21diskmemload09:18:512
24661992323,0cyclictest0-21swapper/211:34:552
24661992323,0cyclictest0-21swapper/210:55:342
24661992323,0cyclictest0-21swapper/210:27:042
24661992323,0cyclictest0-21swapper/210:22:502
24661992322,0cyclictest0-21swapper/209:46:562
2466199232,1cyclictest593-21rm12:11:352
2466199232,1cyclictest593-21rm12:11:352
24661992320,3cyclictest0-21swapper/211:38:512
2466199230,23cyclictest0-21swapper/212:22:172
2466199230,23cyclictest0-21swapper/210:54:152
2466199230,23cyclictest0-21swapper/210:31:452
2466199230,22cyclictest2836-21ssh11:45:032
2466199230,22cyclictest19582-21diskmemload11:05:492
2466199230,22cyclictest0-21swapper/211:00:512
2466199230,0cyclictest0-21swapper/212:33:482
2466199230,0cyclictest0-21swapper/210:40:112
2466199230,0cyclictest0-21swapper/209:22:172
24657992323,0cyclictest19582-21diskmemload10:55:511
24657992323,0cyclictest19582-21diskmemload09:36:591
24657992323,0cyclictest0-21swapper/111:50:021
24657992323,0cyclictest0-21swapper/111:25:081
24657992323,0cyclictest0-21swapper/111:22:551
24657992323,0cyclictest0-21swapper/111:17:101
24657992323,0cyclictest0-21swapper/110:21:031
24657992322,1cyclictest19582-21diskmemload09:41:131
24657992321,1cyclictest25268-21ssh11:07:321
24657992321,1cyclictest15547-21ssh10:02:291
24657992320,2cyclictest29583-21munin-plugin-st08:25:011
2465799231,21cyclictest0-21swapper/109:55:341
2465799231,21cyclictest0-21swapper/109:16:471
2465799230,23cyclictest17185-21ssh11:01:351
2465799230,22cyclictest6181-21sh12:16:231
2465799230,22cyclictest19580-21munin-plugin-st08:05:001
2465799230,22cyclictest0-21swapper/110:35:501
2465799230,22cyclictest0-21swapper/109:10:181
2465799230,22cyclictest0-21swapper/107:56:571
2465799230,1cyclictest0-21swapper/112:27:301
2465799230,0cyclictest19582-21diskmemload09:50:391
2465799230,0cyclictest19582-21diskmemload09:45:181
24653992323,0cyclictest19582-21diskmemload10:14:500
24653992323,0cyclictest0-21swapper/012:37:540
24653992323,0cyclictest0-21swapper/011:10:160
24653992321,1cyclictest62550irq/127-eno112:20:020
24653992321,1cyclictest0-21swapper/011:06:250
24653992320,2cyclictest22386-21ssh09:40:530
2465399230,2cyclictest19582-21diskmemload11:21:580
2465399230,23cyclictest19582-21diskmemload12:00:160
2465399230,23cyclictest19582-21diskmemload11:40:110
2465399230,23cyclictest0-21swapper/012:06:130
2465399230,23cyclictest0-21swapper/011:00:040
2465399230,23cyclictest0-21swapper/010:56:430
2465399230,23cyclictest0-21swapper/009:50:260
2465399230,22cyclictest7125-21cron07:40:010
2465399230,22cyclictest19582-21diskmemload09:55:230
2465399230,22cyclictest18440-21apt-get12:26:570
2465399230,22cyclictest15040-21diskmemload11:55:050
2465399230,22cyclictest10704-21sh09:30:370
2465399230,22cyclictest0-21swapper/012:31:240
2465399230,22cyclictest0-21swapper/010:27:450
2465399230,22cyclictest0-21swapper/010:20:450
2465399230,22cyclictest0-21swapper/010:03:240
2465399230,22cyclictest0-21swapper/009:45:020
2465399230,1cyclictest0-21swapper/009:26:590
2465399230,0cyclictest0-21swapper/010:44:050
24664992222,0cyclictest0-21swapper/310:57:383
24664992222,0cyclictest0-21swapper/310:26:493
24664992222,0cyclictest0-21swapper/310:03:083
24664992220,1cyclictest0-21swapper/311:00:013
24664992219,2cyclictest31903-21ssh09:20:513
24664992219,2cyclictest19544-21idleruntime-cro08:05:003
2466499220,22cyclictest0-21swapper/310:11:193
2466499220,21cyclictest31803-21awk07:25:013
2466499220,21cyclictest25019-21apt-get07:11:563
2466499220,21cyclictest0-21swapper/311:53:273
2466499220,21cyclictest0-21swapper/309:26:013
2466499220,21cyclictest0-21swapper/308:11:573
2466499220,1cyclictest21827-21ssh11:05:093
2466499220,1cyclictest1649-21cron08:30:013
2466499220,1cyclictest14766-21munin-run07:55:003
24661992222,0cyclictest0-21swapper/211:55:422
24661992222,0cyclictest0-21swapper/211:20:102
24661992222,0cyclictest0-21swapper/210:15:332
24661992222,0cyclictest0-21swapper/209:32:292
2466199220,2cyclictest7036-21ssh09:55:562
2466199220,22cyclictest0-21swapper/210:04:042
2466199220,22cyclictest0-21swapper/209:13:552
2466199220,21cyclictest8014-21apt-get08:46:572
2466199220,21cyclictest29443-21awk07:20:002
2466199220,21cyclictest26518-21ssh12:05:182
2466199220,21cyclictest12437-21ssh11:25:302
2466199220,21cyclictest0-21swapper/210:06:142
2466199220,1cyclictest19582-21diskmemload12:39:022
24657992222,0cyclictest0-21swapper/110:47:491
24657992220,1cyclictest0-21swapper/111:45:041
24657992220,1cyclictest0-21swapper/107:31:571
2465799220,22cyclictest29085-21ssh12:35:591
2465799220,22cyclictest0-21swapper/111:40:251
2465799220,21cyclictest0-21swapper/109:00:011
24653992221,1cyclictest62550irq/127-eno110:51:100
24653992221,1cyclictest19582-21diskmemload09:20:170
24653992221,1cyclictest0-21swapper/011:26:020
24653992221,1cyclictest0-21swapper/009:10:160
24653992221,0cyclictest0-21swapper/008:16:550
2465399221,21cyclictest62550irq/127-eno111:50:560
2465399220,21cyclictest19582-21diskmemload10:30:010
2465399220,21cyclictest0-21swapper/009:15:220
2465399220,0cyclictest23271-21apt-get11:35:020
2465399220,0cyclictest0-21swapper/012:10:100
2465399220,0cyclictest0-21swapper/012:10:100
24664992119,1cyclictest7183-21basename07:40:013
2466499210,21cyclictest0-21swapper/307:45:023
2466499210,1cyclictest7212-21apt-get08:45:023
2466499210,0cyclictest12805-21apt-get08:56:583
24661992121,0cyclictest19582-21diskmemload12:01:052
2466199210,21cyclictest0-21swapper/212:25:062
2466199210,21cyclictest0-21swapper/211:10:222
2466199210,1cyclictest313-21systemd-journal07:40:012
2466199210,0cyclictest0-21swapper/209:50:152
2466199210,0cyclictest0-21swapper/208:11:562
24657992120,1cyclictest0-21swapper/108:26:551
24657992119,1cyclictest9993-21latency_hist08:50:001
24653992120,1cyclictest29584-21munin-run08:25:010
24653992119,1cyclictest0-21swapper/007:55:000
2465399210,20cyclictest0-21swapper/008:41:560
2465399210,20cyclictest0-21swapper/007:31:570
24664992020,0cyclictest0-21swapper/308:21:573
24664992020,0cyclictest0-21swapper/307:31:573
24664992018,1cyclictest7578-21apt-get07:41:583
2466499200,20cyclictest0-21swapper/308:31:553
2466499200,0cyclictest0-21swapper/308:41:563
24661992020,0cyclictest0-21swapper/209:06:582
24661992019,1cyclictest27025-21perf07:15:002
2466199200,0cyclictest10410-21apt-get08:51:562
2466199200,0cyclictest0-21swapper/208:01:562
24657992020,0cyclictest0-21swapper/109:01:561
24657992020,0cyclictest0-21swapper/108:41:561
24657992020,0cyclictest0-21swapper/107:51:551
24657992019,1cyclictest0-21swapper/108:16:551
2465799200,20cyclictest0-21swapper/108:51:561
24653992020,0cyclictest0-21swapper/008:01:560
24653992020,0cyclictest0-21swapper/007:41:580
24653992020,0cyclictest0-21swapper/007:26:580
24653992019,1cyclictest0-21swapper/008:35:020
24653992018,1cyclictest17172-21ls08:00:000
24664991919,0cyclictest0-21swapper/307:56:573
24661991919,0cyclictest12358-21perf07:50:002
24661991919,0cyclictest0-21swapper/209:01:562
24661991919,0cyclictest0-21swapper/208:06:562
24661991919,0cyclictest0-21swapper/207:41:582
24657991919,0cyclictest0-21swapper/108:31:551
24657991919,0cyclictest0-21swapper/107:41:581
24657991919,0cyclictest0-21swapper/107:16:571
24653991917,1cyclictest9549-21apt-get07:45:020
24653991917,1cyclictest141rcuc/007:20:000
2465399190,18cyclictest0-21swapper/007:11:560
24661991818,0cyclictest5225-21apt-get08:41:562
24661991818,0cyclictest0-21swapper/208:56:572
24661991815,2cyclictest2208-21munin-run07:30:012
24657991818,0cyclictest0-21swapper/107:45:011
24657991816,1cyclictest0-21swapper/107:40:011
24657991815,2cyclictest2201-21grep07:30:011
24657991814,3cyclictest24546-21latency_hist08:15:011
2465799180,17cyclictest0-21swapper/108:36:561
24664991717,0cyclictest19970-21apt-get08:06:563
24664991717,0cyclictest0-21swapper/309:06:583
24661991717,0cyclictest2664-21apt-get07:31:572
24661991716,1cyclictest27582-21apt-get08:21:572
24661991716,1cyclictest271rcuc/208:16:552
24657991717,0cyclictest0-21swapper/109:06:581
24653991715,1cyclictest32370-21apt-get08:31:550
24664991614,1cyclictest0-21swapper/307:16:363
24661991614,1cyclictest2571-21apt-get08:35:022
24661991614,1cyclictest17176-21sleep08:00:002
24661991614,1cyclictest14750-21sleep07:55:002
24657991613,2cyclictest0-21swapper/107:12:041
2465399160,5cyclictest0-21swapper/008:11:560
2466199150,14cyclictest32370-21apt-get08:31:552
2466499140,14cyclictest0-21swapper/307:25:123
2466499140,0cyclictest0-21swapper/309:00:073
2466499140,0cyclictest0-21swapper/308:51:293
24661991414,0cyclictest0-21swapper/207:21:322
2466199140,14cyclictest0-21swapper/208:25:172
24653991414,0cyclictest0-21swapper/008:25:040
2465399140,14cyclictest0-21swapper/008:50:520
2465399140,0cyclictest0-21swapper/009:05:090
2465399140,0cyclictest0-21swapper/009:01:040
2465399140,0cyclictest0-21swapper/008:55:540
2465399140,0cyclictest0-21swapper/008:05:160
2465399140,0cyclictest0-21swapper/007:20:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional