You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 17:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Thu May 07, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1678699250,24cyclictest10166-21diskmemload10:09:563
1678699250,24cyclictest0-21swapper/312:01:103
1678699250,24cyclictest0-21swapper/307:21:303
1678599250,24cyclictest0-21swapper/210:45:002
16784992523,1cyclictest0-21swapper/112:30:121
16784992523,1cyclictest0-21swapper/112:21:591
16784992523,1cyclictest0-21swapper/109:36:471
1678499250,2cyclictest7574-21rm10:04:291
1678499250,24cyclictest25600-21ssh11:16:361
16783992523,1cyclictest0-21swapper/012:36:360
16783992522,2cyclictest606-21dbus-daemon11:55:000
1678399250,24cyclictest24832-21sh09:21:550
1678399250,24cyclictest10166-21diskmemload09:50:030
1678399250,24cyclictest10156-21rm12:29:160
16786992424,0cyclictest0-21swapper/311:30:213
16786992423,1cyclictest19525-21ssh10:42:113
16786992421,2cyclictest20584-21cron12:10:013
1678699240,0cyclictest0-21swapper/312:27:313
16785992421,2cyclictest10297-21cron10:35:012
16785992420,2cyclictest0-21swapper/211:37:432
16785992420,1cyclictest10166-21diskmemload09:18:162
1678599240,24cyclictest0-21swapper/212:17:222
1678599240,23cyclictest1288-21ssh11:23:352
1678599240,23cyclictest10166-21diskmemload12:10:042
1678599240,23cyclictest10166-21diskmemload10:51:392
1678599240,23cyclictest0-21swapper/211:08:392
1678599240,1cyclictest0-21swapper/210:58:252
16784992423,1cyclictest0-21swapper/111:23:281
16784992422,1cyclictest0-21swapper/109:10:151
1678499240,24cyclictest0-21swapper/111:31:461
1678499240,24cyclictest0-21swapper/110:37:011
1678499240,23cyclictest16860-21sh10:40:551
1678499240,23cyclictest0-21swapper/109:32:131
1678499240,1cyclictest4935-21ssh10:30:051
1678499240,0cyclictest10166-21diskmemload11:26:091
1678499240,0cyclictest0-21swapper/112:15:421
16783992424,0cyclictest0-21swapper/009:47:360
16783992422,1cyclictest0-21swapper/012:18:090
16783992422,1cyclictest0-21swapper/011:25:550
16783992420,3cyclictest30498-21rm10:51:460
1678399240,2cyclictest15467-21rm10:39:240
1678399240,24cyclictest0-21swapper/009:41:390
1678399240,23cyclictest6498-21apt-get07:56:300
1678399240,23cyclictest62550irq/127-eno111:38:290
1678399240,23cyclictest29890-21sh10:23:350
1678399240,23cyclictest12449-21ssh11:05:130
1678399240,23cyclictest0-21swapper/009:30:020
1678399240,22cyclictest0-21swapper/010:29:450
1678399240,1cyclictest0-21swapper/012:11:400
16786992323,0cyclictest0-21swapper/310:24:343
16786992323,0cyclictest0-21swapper/310:10:573
16786992323,0cyclictest0-21swapper/309:10:573
16786992322,1cyclictest32449-21ssh12:20:263
16786992321,1cyclictest16369-21ssh09:15:243
16786992321,1cyclictest15448-21ssh10:39:233
16786992321,1cyclictest10166-21diskmemload11:15:593
1678699230,2cyclictest3182-21rm10:28:373
1678699230,23cyclictest0-21swapper/312:35:183
1678699230,23cyclictest0-21swapper/311:21:043
1678699230,23cyclictest0-21swapper/309:57:003
1678699230,23cyclictest0-21swapper/309:35:073
1678699230,22cyclictest783-21snmpd09:26:493
1678699230,22cyclictest5978-21cut11:56:353
1678699230,22cyclictest26554-21ssh12:15:113
1678699230,22cyclictest25064-21chrt10:46:583
1678699230,22cyclictest24291-21sh09:50:593
1678699230,22cyclictest21799-21ssh09:20:083
1678699230,0cyclictest0-21swapper/312:14:113
1678699230,0cyclictest0-21swapper/311:07:353
1678699230,0cyclictest0-21swapper/311:00:113
16785992323,0cyclictest0-21swapper/212:23:552
16785992323,0cyclictest0-21swapper/211:33:032
16785992323,0cyclictest0-21swapper/210:48:462
16785992323,0cyclictest0-21swapper/209:29:002
16785992322,1cyclictest10166-21diskmemload09:43:482
16785992322,0cyclictest10166-21diskmemload09:11:242
16785992321,1cyclictest21587-21perf07:20:012
16785992320,3cyclictest0-21swapper/212:27:502
16785992320,2cyclictest23775-21ssh11:15:172
16785992320,2cyclictest10552-21sh11:03:002
1678599230,2cyclictest8915-21diskmemload10:06:012
1678599230,2cyclictest18613-21taskset09:45:522
1678599230,23cyclictest0-21swapper/211:40:462
1678599230,23cyclictest0-21swapper/210:28:112
1678599230,22cyclictest6474-21perf09:35:012
1678599230,22cyclictest10166-21diskmemload09:20:412
1678599230,0cyclictest12166-21apt-get12:31:322
1678599230,0cyclictest10166-21diskmemload10:21:332
1678599230,0cyclictest0-21swapper/212:01:432
1678599230,0cyclictest0-21swapper/211:53:342
1678599230,0cyclictest0-21swapper/209:51:332
1678599230,0cyclictest0-21swapper/209:39:232
16784992323,0cyclictest10166-21diskmemload11:36:421
16784992323,0cyclictest0-21swapper/112:10:431
16784992323,0cyclictest0-21swapper/111:55:461
16784992323,0cyclictest0-21swapper/110:59:341
16784992323,0cyclictest0-21swapper/110:28:111
16784992323,0cyclictest0-21swapper/110:22:051
16784992323,0cyclictest0-21swapper/109:47:381
16784992321,1cyclictest22-21ksoftirqd/107:20:011
16784992321,1cyclictest0-21swapper/111:40:131
16784992321,1cyclictest0-21swapper/108:40:001
16784992320,2cyclictest31267-21idleruntime-cro07:40:001
1678499230,23cyclictest10166-21diskmemload09:18:401
1678499230,23cyclictest0-21swapper/111:13:361
1678499230,23cyclictest0-21swapper/111:06:431
1678499230,23cyclictest0-21swapper/110:48:341
1678499230,22cyclictest27708-21ssh09:25:291
1678499230,22cyclictest16449-21apt-get12:35:011
1678499230,22cyclictest14784-21ssh10:11:191
1678499230,22cyclictest10166-21diskmemload10:17:031
1678499230,22cyclictest0-21swapper/109:20:521
1678499230,1cyclictest25680-21ssh11:45:481
1678499230,0cyclictest0-21swapper/111:03:081
1678499230,0cyclictest0-21swapper/109:51:521
1678499230,0cyclictest0-21swapper/109:40:421
16783992323,0cyclictest62550irq/127-eno109:17:340
16783992323,0cyclictest10166-21diskmemload10:09:440
16783992323,0cyclictest0-21swapper/011:44:090
16783992323,0cyclictest0-21swapper/011:24:060
16783992323,0cyclictest0-21swapper/009:35:480
16783992322,1cyclictest62550irq/127-eno109:56:510
16783992322,1cyclictest0-21swapper/010:00:490
16783992321,1cyclictest6635-21hddtemp_smartct10:31:330
16783992321,1cyclictest11067-21ssh09:10:570
16783992321,1cyclictest0-21swapper/011:20:010
1678399231,1cyclictest8698-21sh11:30:490
1678399230,2cyclictest27480-21ptp4l11:46:380
1678399230,23cyclictest10166-21diskmemload09:29:390
1678399230,23cyclictest0-21swapper/010:42:030
1678399230,22cyclictest3692-21ssh12:22:590
1678399230,22cyclictest18300-21sh12:06:460
1678399230,0cyclictest0-21swapper/012:30:160
1678399230,0cyclictest0-21swapper/011:57:390
1678399230,0cyclictest0-21swapper/010:58:120
1678399230,0cyclictest0-21swapper/010:13:300
16786992222,0cyclictest10166-21diskmemload10:55:223
16786992222,0cyclictest10166-21diskmemload10:00:473
16786992222,0cyclictest0-21swapper/311:47:513
16786992222,0cyclictest0-21swapper/309:45:193
16786992221,1cyclictest14783-21ssh11:36:233
16786992221,1cyclictest12724-21ssh12:31:353
16786992220,1cyclictest10166-21diskmemload11:42:103
16786992220,1cyclictest0-21swapper/310:50:453
16786992219,2cyclictest7394-21grep10:31:383
1678699220,22cyclictest19981-21ssh10:15:063
1678699220,22cyclictest0-21swapper/311:26:033
1678699220,21cyclictest10166-21diskmemload11:10:293
1678699220,21cyclictest0-21swapper/311:50:083
1678699220,21cyclictest0-21swapper/309:40:153
1678699220,21cyclictest0-21swapper/308:31:313
1678699220,1cyclictest948-21sh09:30:023
16785992222,0cyclictest0-21swapper/210:00:092
16785992221,1cyclictest0-21swapper/210:35:322
16785992220,1cyclictest28152-21perf08:40:002
16785992220,1cyclictest26375-21idleruntime-cro07:30:012
16785992220,1cyclictest0-21swapper/211:56:412
16785992220,1cyclictest0-21swapper/211:11:392
16785992217,4cyclictest0-21swapper/210:15:402
1678599220,22cyclictest0-21swapper/211:48:422
1678599220,21cyclictest988-21rm09:58:202
1678599220,21cyclictest20938-21perf08:25:002
1678599220,21cyclictest17856-21ssh12:36:072
1678599220,21cyclictest10166-21diskmemload12:06:472
1678599220,21cyclictest0-21swapper/211:25:152
1678599220,21cyclictest0-21swapper/210:10:522
16784992222,0cyclictest0-21swapper/112:00:551
16784992220,1cyclictest2986-21perf08:55:011
16784992220,1cyclictest0-21swapper/112:05:141
16784992220,1cyclictest0-21swapper/109:55:341
1678499220,21cyclictest10166-21diskmemload11:50:141
1678499220,21cyclictest0-21swapper/112:26:371
1678499220,21cyclictest0-21swapper/110:50:171
1678499220,21cyclictest0-21swapper/108:16:301
1678499220,21cyclictest0-21swapper/107:21:301
1678499220,1cyclictest0-21swapper/110:06:361
16783992220,1cyclictest23974-21ls07:25:010
16783992220,1cyclictest0-21swapper/010:15:010
16783992220,1cyclictest0-21swapper/007:15:010
1678399220,21cyclictest0-21swapper/012:00:150
1678399220,21cyclictest0-21swapper/011:10:080
1678399220,1cyclictest6069-21apt-get11:00:010
1678399220,1cyclictest0-21swapper/008:55:010
16786992120,1cyclictest3351-21apt-get08:56:303
1678699210,20cyclictest0-21swapper/307:56:303
16785992120,1cyclictest23714-21apt-get08:31:312
1678599210,20cyclictest13703-21apt-get08:11:292
1678599210,0cyclictest0-21swapper/207:11:302
16784992121,0cyclictest18922-21apt-get08:21:311
16784992121,0cyclictest0-21swapper/108:41:301
16784992119,1cyclictest6121-21turbostat07:55:001
1678499210,1cyclictest28764-21perf07:35:001
1678499210,0cyclictest0-21swapper/108:56:301
16783992120,1cyclictest0-21swapper/010:45:530
1678399210,21cyclictest0-21swapper/007:26:300
1678399210,1cyclictest15739-21perf08:15:010
16786992019,1cyclictest26392-21awk07:30:013
16786992018,1cyclictest493-21munin-run08:50:013
16785992020,0cyclictest0-21swapper/207:36:312
1678599200,0cyclictest4104-21apt-get07:51:322
1678599200,0cyclictest0-21swapper/209:01:332
1678599200,0cyclictest0-21swapper/208:16:302
16784992020,0cyclictest0-21swapper/107:26:301
16784992020,0cyclictest0-21swapper/107:11:301
1678499200,0cyclictest1695-21apt-get07:46:301
1678399200,0cyclictest0-21swapper/008:36:310
1678399200,0cyclictest0-21swapper/007:46:300
16786991919,0cyclictest29146-21apt-get07:36:313
16786991917,1cyclictest18922-21apt-get08:21:313
16786991917,1cyclictest0-21swapper/307:46:303
16786991916,2cyclictest7794-21wc09:05:013
16785991919,0cyclictest0-21swapper/209:06:302
16785991919,0cyclictest0-21swapper/208:46:312
16785991919,0cyclictest0-21swapper/208:41:302
16783991919,0cyclictest0-21swapper/009:01:330
16783991919,0cyclictest0-21swapper/008:01:320
16783991919,0cyclictest0-21swapper/008:01:320
16786991818,0cyclictest0-21swapper/308:26:303
16786991818,0cyclictest0-21swapper/308:11:303
16786991817,0cyclictest0-21swapper/307:51:323
16785991818,0cyclictest0-21swapper/208:56:302
16783991818,0cyclictest23714-21apt-get08:31:300
16783991818,0cyclictest0-21swapper/008:21:310
16786991717,0cyclictest16096-21apt-get08:16:303
16786991715,1cyclictest1328-21munin-run07:45:003
1678599170,16cyclictest0-21swapper/208:30:002
16784991716,0cyclictest0-21swapper/108:46:301
16783991717,0cyclictest0-21swapper/007:41:290
16783991716,1cyclictest30919-21apt-get08:46:310
16783991715,1cyclictest28742-21cron07:35:000
16786991614,1cyclictest10188-21perf09:10:013
1678699160,1cyclictest2986-21perf08:55:013
16785991616,0cyclictest0-21swapper/208:51:312
16785991616,0cyclictest0-21swapper/207:46:302
16785991616,0cyclictest0-21swapper/207:41:292
16784991614,1cyclictest23353-21munin-run08:30:001
1678499160,15cyclictest0-21swapper/108:15:011
1678399160,5cyclictest0-21swapper/009:00:010
1678399160,15cyclictest13307-21cron08:10:010
16786991515,0cyclictest0-21swapper/308:36:313
1678599150,1cyclictest23006-21ntp_states07:21:362
16784991515,0cyclictest0-21swapper/108:01:321
16784991515,0cyclictest0-21swapper/108:01:321
16784991515,0cyclictest0-21swapper/107:56:301
16784991513,1cyclictest0-21swapper/108:31:361
1678499150,14cyclictest0-21swapper/108:06:311
16783991515,0cyclictest0-21swapper/007:51:320
16783991515,0cyclictest0-21swapper/007:36:310
1678399150,14cyclictest0-21swapper/007:16:310
16786991413,1cyclictest18528-21/usr/sbin/munin07:11:383
1678699140,14cyclictest0-21swapper/308:40:183
1678699140,14cyclictest0-21swapper/308:05:243
1678699140,14cyclictest0-21swapper/308:02:063
1678699140,14cyclictest0-21swapper/308:02:063
1678699140,14cyclictest0-21swapper/307:15:013
1678599140,14cyclictest0-21swapper/208:05:352
1678599140,14cyclictest0-21swapper/208:00:092
1678599140,14cyclictest0-21swapper/208:00:092
1678599140,0cyclictest0-21swapper/207:55:282
1678599140,0cyclictest0-21swapper/207:32:262
1678499140,14cyclictest0-21swapper/107:41:091
16783991414,0cyclictest0-21swapper/009:05:300
16783991414,0cyclictest0-21swapper/008:40:180
1678399140,14cyclictest0-21swapper/008:15:480
1678399140,0cyclictest0-21swapper/008:26:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional