You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 20:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Apr 02, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26303211692,19sleep00-21swapper/007:06:470
26296211698,12sleep30-21swapper/307:06:423
26372211596,14sleep10-21swapper/107:07:401
26410211092,12sleep20-21swapper/207:08:092
327672790,0sleep00-21swapper/009:05:130
3852760,1sleep10-21swapper/111:55:181
42472740,0sleep00-21swapper/010:51:540
303462720,0sleep00-21swapper/007:25:090
295622720,0sleep00-21swapper/009:37:550
106912710,0sleep30-21swapper/312:40:003
2659899281,25cyclictest5161-21ssh10:20:102
2659799240,22cyclictest0-21swapper/109:45:001
2659699241,21cyclictest0-21swapper/011:00:120
2659899210,19cyclictest0-21swapper/211:35:112
2659899210,19cyclictest0-21swapper/208:45:112
2659799210,19cyclictest0-21swapper/108:05:101
26596992116,4cyclictest0-21swapper/011:05:110
2659999203,2cyclictest0-21swapper/311:50:043
2659999200,2cyclictest0-21swapper/311:55:123
2659999200,18cyclictest0-21swapper/311:45:113
2659799200,2cyclictest0-21swapper/107:25:071
2659699200,18cyclictest0-21swapper/008:35:110
26599991916,2cyclictest27669-21kworker/u8:110:31:043
26598991916,2cyclictest12548-21kworker/u8:011:22:042
26598991916,2cyclictest12548-21kworker/u8:011:22:042
26598991913,5cyclictest26595-21cyclictest07:27:042
2659899190,2cyclictest0-21swapper/212:10:092
2659899190,14cyclictest0-21swapper/209:32:042
317062180,1sleep1221ktimersoftd/111:54:521
26598991815,2cyclictest27669-21kworker/u8:110:27:042
26598991815,2cyclictest18775-21kworker/u8:211:11:042
26598991815,2cyclictest16601-21kworker/u8:110:02:012
2659899181,15cyclictest27304-21munin-node2
26599991714,2cyclictest27669-21kworker/u8:110:14:053
26599991714,2cyclictest16601-21kworker/u8:110:01:043
26599991714,2cyclictest12578-21ssh10:27:043
26599991714,2cyclictest12548-21kworker/u8:011:28:053
2659899173,8cyclictest1326-21ssh10:50:002
26598991714,2cyclictest31810-21kworker/u8:212:30:042
26598991714,2cyclictest18775-21kworker/u8:211:08:052
26598991713,2cyclictest21692-21kworker/u8:010:05:042
2659999161,3cyclictest18308-21latency_hist08:30:003
26599991613,2cyclictest347-21kworker/u8:212:04:053
26599991613,2cyclictest21757-21kworker/u8:009:33:043
26599991613,2cyclictest21757-21kworker/u8:009:26:013
26599991613,2cyclictest21757-21kworker/u8:009:15:043
26599991613,2cyclictest12548-21kworker/u8:011:21:053
26599991613,2cyclictest12548-21kworker/u8:011:21:043
26598991613,2cyclictest6428-21kworker/u8:012:01:042
26598991613,2cyclictest29876-21kworker/u8:009:57:042
26598991613,2cyclictest29876-21kworker/u8:009:48:052
26598991613,2cyclictest27669-21kworker/u8:110:10:052
26598991613,2cyclictest24413-21kworker/u8:110:42:052
2659899160,2cyclictest0-21swapper/209:43:042
2659799161,13cyclictest0-21swapper/110:35:061
2659799161,12cyclictest13094-21sort09:55:001
2659699161,13cyclictest22007-21ssh12:17:380
268172150,2sleep30-21swapper/312:22:373
26599991512,2cyclictest30698-21kworker/u8:211:37:043
26599991512,2cyclictest29876-21kworker/u8:009:39:043
26599991512,2cyclictest27669-21kworker/u8:110:22:043
26599991512,2cyclictest25332-21kworker/u8:111:15:043
26599991512,2cyclictest25332-21kworker/u8:111:15:043
26599991512,2cyclictest18775-21kworker/u8:211:12:043
26599991512,2cyclictest12548-21kworker/u8:011:02:063
2659999150,2cyclictest29876-21kworker/u8:009:43:043
2659899152,2cyclictest0-21swapper/212:21:042
26598991512,2cyclictest7007-21kworker/u8:210:57:042
26598991512,2cyclictest5997-21kworker/u8:112:38:042
26598991512,2cyclictest347-21kworker/u8:212:06:042
26598991512,2cyclictest29696-21kworker/u8:207:48:042
26598991512,2cyclictest24496-21kworker/u8:108:54:042
26598991512,2cyclictest16823-21kworker/u8:210:32:052
26598991512,2cyclictest15891-21kworker/u8:208:32:012
26598991512,2cyclictest15891-21kworker/u8:208:27:042
26598991512,2cyclictest11314-21kworker/u8:207:13:042
2659899151,12cyclictest925-21ntp_states09:05:172
26598991511,2cyclictest0-21swapper/208:05:052
2659899150,13cyclictest26320-21fschecks_count11:15:132
2659899150,13cyclictest26320-21fschecks_count11:15:132
2659799151,12cyclictest7733-21ssh12:36:021
26597991510,3cyclictest17704-21sh11:40:121
2659799150,7cyclictest0-21swapper/111:01:581
2659799150,3cyclictest0-21swapper/107:35:581
2659799150,2cyclictest1822-21diskmemload12:27:401
2659799150,13cyclictest0-21swapper/111:37:501
2659799150,13cyclictest0-21swapper/111:15:111
2659799150,13cyclictest0-21swapper/111:15:101
2659699150,2cyclictest0-21swapper/012:10:090
2659699150,13cyclictest0-21swapper/012:25:130
286542140,2sleep00-21swapper/011:50:440
2659999149,3cyclictest1822-21diskmemload09:45:073
2659999141,2cyclictest22429-21ssh10:37:253
26599991411,2cyclictest7007-21kworker/u8:210:58:053
26599991411,2cyclictest6428-21kworker/u8:012:11:043
26599991411,2cyclictest29876-21kworker/u8:009:53:043
26599991411,2cyclictest24496-21kworker/u8:108:48:043
26599991411,2cyclictest24020-21kworker/u8:012:32:053
26599991411,2cyclictest16823-21kworker/u8:210:41:043
26599991411,2cyclictest16601-21kworker/u8:109:58:013
26599991411,2cyclictest12031-21kworker/u8:011:40:043
26599991411,2cyclictest11314-21kworker/u8:207:10:043
26599991410,2cyclictest0-21swapper/308:40:003
2659999140,10cyclictest0-21swapper/307:18:013
2659899142,7cyclictest32489-21apt-get07:35:002
26598991411,2cyclictest8590-21kworker/u8:008:20:012
26598991411,2cyclictest8590-21kworker/u8:008:20:012
26598991411,2cyclictest8590-21kworker/u8:008:19:042
26598991411,2cyclictest8590-21kworker/u8:008:10:042
26598991411,2cyclictest29696-21kworker/u8:208:01:042
26598991411,2cyclictest21757-21kworker/u8:009:01:042
26598991411,2cyclictest1700-21kworker/u8:209:13:042
26598991411,2cyclictest15891-21kworker/u8:208:36:042
26598991411,2cyclictest13237-21kworker/u8:209:23:042
26598991411,2cyclictest13014-21kworker/u8:112:26:042
26598991411,2cyclictest12548-21kworker/u8:011:01:042
2659899141,11cyclictest3728-21runrttasks10:51:282
2659899140,2cyclictest0-21swapper/211:48:042
2659899140,2cyclictest0-21swapper/211:41:002
2659899140,2cyclictest0-21swapper/210:36:052
2659899140,13cyclictest0-21swapper/211:55:102
2659899140,12cyclictest5380-21updatedb.mlocat07:52:272
2659899140,12cyclictest0-21swapper/209:37:192
2659799149,3cyclictest0-21swapper/112:15:321
26597991411,2cyclictest0-21swapper/110:55:501
26597991411,2cyclictest0-21swapper/110:19:501
26597991411,2cyclictest0-21swapper/109:36:411
2659799140,3cyclictest0-21swapper/109:13:111
2659799140,3cyclictest0-21swapper/109:05:181
2659799140,13cyclictest0-21swapper/112:01:301
2659799140,12cyclictest0-21swapper/111:45:071
2659799140,12cyclictest0-21swapper/111:12:501
2659699149,3cyclictest8506-21taskset12:04:030
2659699149,3cyclictest32386-21switchtime11:21:010
2659699149,3cyclictest32386-21switchtime11:21:010
2659699149,3cyclictest14805-21ssh11:36:050
2659699141,2cyclictest8594-21apt-get09:50:100
26596991411,2cyclictest0-21swapper/010:33:320
2659699141,11cyclictest8388-21ssh09:15:350
321422130,2sleep01822-21diskmemload10:47:310
26599991310,2cyclictest347-21kworker/u8:212:07:043
26599991310,2cyclictest29696-21kworker/u8:207:47:053
26599991310,2cyclictest27439-21kworker/u8:107:30:043
26599991310,2cyclictest27439-21kworker/u8:107:26:043
26599991310,2cyclictest21757-21kworker/u8:009:10:053
26599991310,2cyclictest21757-21kworker/u8:008:52:043
26599991310,2cyclictest13237-21kworker/u8:209:22:053
26599991310,2cyclictest13014-21kworker/u8:112:25:043
26599991310,2cyclictest0-21swapper/312:19:063
26599991310,2cyclictest0-21swapper/310:45:163
2659999130,9cyclictest0-21swapper/310:54:043
2659999130,12cyclictest0-21swapper/310:15:153
2659999130,11cyclictest0-21swapper/310:09:193
2659899132,7cyclictest0-21swapper/209:55:002
2659899132,6cyclictest0-21swapper/207:25:002
26598991310,2cyclictest32378-21kworker/u8:007:42:012
26598991310,2cyclictest23147-21kworker/u8:007:16:042
26598991310,2cyclictest21757-21kworker/u8:008:41:042
2659899130,2cyclictest0-21swapper/212:18:002
2659899130,2cyclictest0-21swapper/211:25:112
2659899130,12cyclictest0-21swapper/211:33:302
2659899130,12cyclictest0-21swapper/209:29:492
2659799138,3cyclictest0-21swapper/112:20:131
2659799132,6cyclictest0-21swapper/107:55:001
2659799131,7cyclictest20087-21grep10:01:021
2659799131,3cyclictest0-21swapper/111:30:131
2659799131,10cyclictest0-21swapper/109:56:091
2659799131,10cyclictest0-21swapper/107:52:321
26597991310,2cyclictest0-21swapper/111:05:121
26597991310,2cyclictest0-21swapper/110:50:531
26597991310,2cyclictest0-21swapper/110:20:161
26597991310,2cyclictest0-21swapper/110:10:101
26597991310,2cyclictest0-21swapper/109:41:301
2659799130,2cyclictest0-21swapper/111:27:321
2659799130,11cyclictest1822-21diskmemload09:29:561
2659799130,11cyclictest0-21swapper/110:41:221
2659799130,11cyclictest0-21swapper/109:31:051
2659699138,3cyclictest0-21swapper/012:33:280
2659699132,6cyclictest0-21swapper/007:45:000
2659699132,6cyclictest0-21swapper/007:20:000
26596991310,2cyclictest0-21swapper/012:37:030
26596991310,2cyclictest0-21swapper/009:31:010
26596991310,2cyclictest0-21swapper/009:13:360
26596991310,2cyclictest0-21swapper/008:30:290
2659699130,2cyclictest0-21swapper/010:26:120
2659699130,2cyclictest0-21swapper/010:02:390
2659699130,12cyclictest0-21swapper/012:05:030
2659699130,12cyclictest0-21swapper/011:59:330
2659699130,12cyclictest0-21swapper/011:30:020
2659699130,12cyclictest0-21swapper/010:55:130
2659699130,11cyclictest23461-21pzem_power08:40:390
2659699130,11cyclictest0-21swapper/012:20:120
2659699130,11cyclictest0-21swapper/011:10:140
2659699130,11cyclictest0-21swapper/010:20:190
258312130,1sleep00-21swapper/010:40:490
229252130,2sleep00-21swapper/010:05:060
2659999129,2cyclictest30698-21kworker/u8:211:30:043
2659999129,2cyclictest29696-21kworker/u8:208:04:043
2659999129,2cyclictest24496-21kworker/u8:109:00:043
2659999129,2cyclictest23147-21kworker/u8:007:22:053
2659999129,2cyclictest15891-21kworker/u8:208:30:053
2659999129,2cyclictest15891-21kworker/u8:208:22:043
2659999129,2cyclictest15891-21kworker/u8:208:22:043
2659999120,2cyclictest1822-21diskmemload11:05:273
2659899129,2cyclictest0-21swapper/207:35:072
2659899122,7cyclictest0-21swapper/207:56:582
2659899120,2cyclictest0-21swapper/210:15:162
2659899120,2cyclictest0-21swapper/209:15:562
2659799129,2cyclictest0-21swapper/112:30:031
2659799129,2cyclictest0-21swapper/108:00:071
2659799128,2cyclictest0-21swapper/112:06:031
2659799127,3cyclictest27402-21munin-node1
2659799127,3cyclictest12440-21grep09:20:131
2659799127,3cyclictest0-21swapper/108:10:161
2659799122,7cyclictest0-21swapper/110:31:581
2659799121,9cyclictest0-21swapper/112:11:001
2659799121,3cyclictest16345-21munin-node1
2659799121,3cyclictest0-21swapper/108:35:491
2659799121,3cyclictest0-21swapper/108:15:111
2659799120,2cyclictest0-21swapper/110:45:381
2659799120,2cyclictest0-21swapper/109:16:221
2659799120,11cyclictest0-21swapper/111:20:021
2659799120,11cyclictest0-21swapper/111:20:021
2659799120,11cyclictest0-21swapper/110:26:531
2659799120,11cyclictest0-21swapper/110:06:311
2659799120,11cyclictest0-21swapper/108:20:291
2659799120,11cyclictest0-21swapper/108:20:281
2659799120,10cyclictest0-21swapper/108:45:501
2659699129,2cyclictest1822-21diskmemload09:46:130
2659699129,2cyclictest0-21swapper/011:28:040
2659699129,2cyclictest0-21swapper/010:15:580
2659699129,2cyclictest0-21swapper/009:57:440
2659699129,2cyclictest0-21swapper/009:25:160
2659699129,2cyclictest0-21swapper/008:20:120
2659699129,2cyclictest0-21swapper/008:20:120
2659699129,2cyclictest0-21swapper/008:05:020
2659699121,5cyclictest0-21swapper/011:40:000
2659699120,11cyclictest0-21swapper/010:10:380
2659699120,11cyclictest0-21swapper/009:44:330
2659699120,11cyclictest0-21swapper/008:51:000
2659699120,11cyclictest0-21swapper/007:55:070
2659699120,10cyclictest0-21swapper/008:45:110
239102120,1sleep00-21swapper/011:45:510
2659999118,2cyclictest5837-21munin-node3
2659999118,2cyclictest32378-21kworker/u8:007:37:043
2659999118,2cyclictest29696-21kworker/u8:207:51:043
2659999118,2cyclictest24496-21kworker/u8:108:56:023
2659999118,2cyclictest21757-21kworker/u8:009:05:043
2659999118,2cyclictest21757-21kworker/u8:008:42:043
2659999110,10cyclictest0-21swapper/308:05:143
2659799118,2cyclictest0-21swapper/108:50:141
2659799111,8cyclictest30479-21munin-node1
2659799111,8cyclictest0-21swapper/108:40:151
2659799111,8cyclictest0-21swapper/108:30:141
2659799111,6cyclictest3728-21runrttasks07:32:531
2659799110,9cyclictest0-21swapper/108:55:151
2659699118,2cyclictest0-21swapper/011:17:480
2659699118,2cyclictest0-21swapper/011:17:480
2659699118,2cyclictest0-21swapper/009:21:190
2659699118,2cyclictest0-21swapper/008:15:130
2659699110,1cyclictest0-21swapper/010:35:220
2659999107,2cyclictest11812-21kworker/u8:108:12:053
2659699107,2cyclictest0-21swapper/009:01:020
2659699107,2cyclictest0-21swapper/007:35:090
2659699105,3cyclictest29394-21ps08:55:180
2659699104,4cyclictest28785-21unixbench_multi07:15:580
2659699102,7cyclictest0-21swapper/007:52:580
2659699101,5cyclictest0-21swapper/008:05:000
2659699100,9cyclictest0-21swapper/008:13:590
32144290,2sleep00-21swapper/007:30:590
265999994,3cyclictest13420-21tr08:15:593
265989996,2cyclictest0-21swapper/208:55:102
265979996,2cyclictest0-21swapper/107:45:121
265979991,6cyclictest29741-21taskset07:23:531
265979991,3cyclictest3728-21runrttasks07:10:351
265969994,3cyclictest2958-21cut07:45:080
265969994,3cyclictest17749-21unixbench_multi08:26:020
265999983,3cyclictest2445-21chrt07:42:063
265979980,7cyclictest0-21swapper/107:41:111
265969980,7cyclictest0-21swapper/007:10:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional