You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 18:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Aug 25, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8686210684,16sleep00-21swapper/007:06:280
8664210696,6sleep30-21swapper/307:06:103
7552210279,16sleep20-21swapper/207:05:132
8853210078,15sleep10-21swapper/107:08:381
174052780,1sleep216483-21sendmail-mta09:34:392
219152740,1sleep10-21swapper/109:39:021
69612640,0sleep00-21swapper/009:23:390
898999360,34cyclictest0-21swapper/111:35:121
8991992926,2cyclictest6782-21kworker/u8:212:34:053
8991992926,2cyclictest21638-21kworker/u8:110:47:053
8990992926,2cyclictest32749-21kworker/u8:109:54:052
8990992926,2cyclictest23377-21kworker/u8:010:29:042
8991992825,2cyclictest32749-21kworker/u8:110:12:053
8990992825,2cyclictest7070-21kworker/u8:210:31:052
8990992825,2cyclictest5938-21kworker/u8:211:02:012
8990992825,2cyclictest32749-21kworker/u8:110:15:042
8990992825,2cyclictest21701-21kworker/u8:112:29:052
8990992825,2cyclictest13653-21kworker/u8:111:17:042
8991992724,2cyclictest7594-21kworker/u8:109:36:043
8991992724,2cyclictest7070-21kworker/u8:210:44:043
8991992724,2cyclictest31291-21kworker/u8:111:29:043
8991992724,2cyclictest17496-21kworker/u8:211:47:053
8991992724,2cyclictest14045-21kworker/u8:012:23:043
8990992724,2cyclictest891-21kworker/u8:012:38:052
8990992724,2cyclictest891-21kworker/u8:012:38:042
8990992724,2cyclictest22151-21kworker/u8:009:48:042
8991992623,2cyclictest7070-21kworker/u8:210:50:043
8991992623,2cyclictest32749-21kworker/u8:110:05:053
8991992623,2cyclictest15625-21kworker/u8:209:24:053
8991992621,3cyclictest6699-21sendmail-mta09:25:123
8990992623,2cyclictest7070-21kworker/u8:210:43:042
8990992623,2cyclictest6782-21kworker/u8:212:19:042
8990992623,2cyclictest4774-21kworker/u8:011:46:062
8990992623,2cyclictest4774-21kworker/u8:011:44:042
8990992623,2cyclictest310-21kworker/u8:011:08:042
8990992623,2cyclictest2745-21kworker/u8:008:16:052
8991992522,2cyclictest4774-21kworker/u8:011:42:053
8991992522,2cyclictest32749-21kworker/u8:109:58:063
8991992522,2cyclictest31291-21kworker/u8:111:32:043
8991992522,2cyclictest310-21kworker/u8:011:10:053
8991992522,2cyclictest27143-21kworker/u8:109:17:053
8991992522,2cyclictest15625-21kworker/u8:209:12:053
8990992522,2cyclictest6726-21kworker/u8:007:12:012
8990992522,2cyclictest32749-21kworker/u8:109:55:052
8990992522,2cyclictest32190-21kworker/u8:110:22:052
8990992522,2cyclictest310-21kworker/u8:011:26:042
8990992522,2cyclictest310-21kworker/u8:011:14:052
8990992522,2cyclictest27543-21kworker/u8:111:58:042
8990992522,2cyclictest21638-21kworker/u8:110:52:012
8990992522,2cyclictest17409-21kworker/u8:107:33:042
8990992522,2cyclictest14632-21kworker/u8:209:43:052
899099250,2cyclictest0-21swapper/208:50:012
8988992522,2cyclictest0-21swapper/008:50:000
158612250,1sleep10-21swapper/111:45:161
8991992421,2cyclictest891-21kworker/u8:012:39:053
8991992421,2cyclictest891-21kworker/u8:012:39:043
8991992421,2cyclictest6782-21kworker/u8:212:13:053
8991992421,2cyclictest27543-21kworker/u8:111:59:043
8991992421,2cyclictest2745-21kworker/u8:008:45:043
8991992421,2cyclictest23377-21kworker/u8:010:34:023
8991992421,2cyclictest23092-21kworker/u8:008:04:053
8991992421,2cyclictest23092-21kworker/u8:007:58:013
8991992421,2cyclictest23092-21kworker/u8:007:45:043
8991992421,2cyclictest17496-21kworker/u8:212:03:043
8991992421,2cyclictest17496-21kworker/u8:211:50:043
8991992421,2cyclictest14632-21kworker/u8:209:42:023
899199240,22cyclictest0-21swapper/308:50:023
8990992421,2cyclictest7594-21kworker/u8:109:26:052
8990992421,2cyclictest6782-21kworker/u8:212:32:042
8990992421,2cyclictest6726-21kworker/u8:007:25:052
8990992421,2cyclictest5516-21kworker/u8:208:35:042
8990992421,2cyclictest310-21kworker/u8:010:58:052
8990992421,2cyclictest27543-21kworker/u8:112:00:052
8990992421,2cyclictest2745-21kworker/u8:008:23:042
8990992421,2cyclictest27337-21kworker/u8:208:11:042
8990992421,2cyclictest15625-21kworker/u8:209:20:012
8990992421,2cyclictest15625-21kworker/u8:209:15:052
898999243,19cyclictest207150irq/24-eth111:10:131
8991992320,2cyclictest7594-21kworker/u8:109:30:053
8991992320,2cyclictest5938-21kworker/u8:211:05:043
8991992320,2cyclictest5516-21kworker/u8:208:26:053
8991992320,2cyclictest32595-21kworker/u8:012:08:043
8991992320,2cyclictest23377-21kworker/u8:010:26:043
8991992320,2cyclictest23377-21kworker/u8:010:20:053
8991992320,2cyclictest23377-21kworker/u8:010:16:043
8991992320,2cyclictest13653-21kworker/u8:111:16:043
899199230,21cyclictest0-21swapper/311:35:113
8990992320,2cyclictest2745-21kworker/u8:008:41:052
8990992320,2cyclictest23092-21kworker/u8:007:59:042
8990992320,2cyclictest15625-21kworker/u8:208:55:052
8991992219,2cyclictest6726-21kworker/u8:007:27:053
8991992219,2cyclictest27543-21kworker/u8:112:16:053
8991992219,2cyclictest22151-21kworker/u8:009:46:043
8991992219,2cyclictest21700-21kworker/u8:009:07:053
8990992219,2cyclictest21700-21kworker/u8:009:06:052
8990992219,2cyclictest17496-21kworker/u8:211:51:042
8991992118,2cyclictest6726-21kworker/u8:007:16:023
8991992118,2cyclictest2745-21kworker/u8:008:43:053
8990992118,2cyclictest5516-21kworker/u8:208:30:052
8990992118,2cyclictest21700-21kworker/u8:009:03:042
8990992118,2cyclictest12984-21kworker/u8:108:48:042
899099210,19cyclictest0-21swapper/211:23:052
8991992017,2cyclictest2745-21kworker/u8:008:32:043
8991992017,2cyclictest17409-21kworker/u8:107:34:013
899199200,2cyclictest0-21swapper/309:52:043
899199200,18cyclictest0-21swapper/307:40:133
8990992017,2cyclictest5516-21kworker/u8:208:28:042
8990992017,2cyclictest23092-21kworker/u8:007:51:052
8990992017,2cyclictest23092-21kworker/u8:007:48:042
899099200,4cyclictest3332-21awk12:06:042
899099200,2cyclictest0-21swapper/212:24:042
899099200,2cyclictest0-21swapper/210:38:042
899099200,2cyclictest0-21swapper/210:10:042
8991991916,2cyclictest6726-21kworker/u8:007:22:043
8991991916,2cyclictest21700-21kworker/u8:009:02:043
899199190,2cyclictest25824-21ssh11:22:053
899199190,2cyclictest0-21swapper/310:39:043
899199190,2cyclictest0-21swapper/310:02:043
899199190,2cyclictest0-21swapper/307:39:053
8990991916,2cyclictest6726-21kworker/u8:007:23:042
8990991916,2cyclictest633-21kworker/u8:108:07:052
899099190,2cyclictest0-21swapper/211:30:052
899099190,2cyclictest0-21swapper/208:02:012
899099190,2cyclictest0-21swapper/207:39:042
898899190,18cyclictest0-21swapper/010:50:130
899199180,2cyclictest0-21swapper/310:55:053
899199180,2cyclictest0-21swapper/308:38:013
899199180,13cyclictest0-21swapper/307:52:053
899099180,2cyclictest0-21swapper/211:38:052
159202180,1sleep011-21rcuc/010:39:190
8991991714,2cyclictest6726-21kworker/u8:007:11:043
899199170,2cyclictest0-21swapper/312:25:043
8991991613,2cyclictest2745-21kworker/u8:008:22:053
899199160,2cyclictest3321-21apt-get11:00:043
899199160,2cyclictest0-21swapper/308:05:043
8989991611,3cyclictest0-21swapper/108:45:131
8988991611,3cyclictest0-21swapper/007:40:190
899099150,2cyclictest0-21swapper/209:37:042
899099150,13cyclictest0-21swapper/210:47:472
898999154,9cyclictest0-21swapper/112:20:401
898999152,7cyclictest0-21swapper/110:10:001
898999151,3cyclictest0-21swapper/110:31:461
8989991510,3cyclictest0-21swapper/107:40:181
898999150,2cyclictest0-21swapper/111:20:131
898999150,13cyclictest4809-21ssh12:07:431
898999150,13cyclictest0-21swapper/111:00:181
8988991510,3cyclictest0-21swapper/009:41:010
898899150,13cyclictest0-21swapper/010:28:450
899199140,12cyclictest0-21swapper/308:58:043
898999149,3cyclictest28768-21ssh11:25:161
898999149,3cyclictest0-21swapper/112:35:171
898999149,3cyclictest0-21swapper/112:35:161
898999149,3cyclictest0-21swapper/109:33:291
8989991411,2cyclictest0-21swapper/111:57:531
8989991411,2cyclictest0-21swapper/110:52:131
8989991411,2cyclictest0-21swapper/109:22:531
898999140,13cyclictest0-21swapper/112:33:531
898999140,13cyclictest0-21swapper/110:28:231
898999140,13cyclictest0-21swapper/110:00:121
898999140,13cyclictest0-21swapper/109:56:031
898999140,12cyclictest0-21swapper/112:01:031
898999140,12cyclictest0-21swapper/111:40:021
898899149,3cyclictest0-21swapper/009:31:520
8988991411,2cyclictest0-21swapper/011:34:230
8988991411,2cyclictest0-21swapper/009:35:110
898899140,3cyclictest31552-21sh11:28:280
898899140,3cyclictest0-21swapper/011:49:290
898899140,12cyclictest9268-21ssh11:39:080
898899140,12cyclictest28205-21df_inode09:45:140
898899140,12cyclictest0-21swapper/010:44:490
898899140,12cyclictest0-21swapper/009:54:320
898899140,12cyclictest0-21swapper/009:16:180
899199130,2cyclictest0-21swapper/308:14:043
899099132,6cyclictest14806-21ssh10:05:002
899099130,2cyclictest0-21swapper/207:44:052
898999139,2cyclictest24384-21ssh09:40:541
898999132,6cyclictest0-21swapper/110:55:001
898999132,6cyclictest0-21swapper/109:50:001
898999132,6cyclictest0-21swapper/107:45:001
898999131,3cyclictest0-21swapper/109:10:291
898999131,3cyclictest0-21swapper/107:50:151
8989991310,2cyclictest0-21swapper/111:54:281
8989991310,2cyclictest0-21swapper/111:33:141
8989991310,2cyclictest0-21swapper/110:44:011
8989991310,2cyclictest0-21swapper/110:35:241
8989991310,2cyclictest0-21swapper/110:23:461
8989991310,2cyclictest0-21swapper/110:18:131
8989991310,2cyclictest0-21swapper/110:13:591
8989991310,2cyclictest0-21swapper/108:50:171
898999130,2cyclictest0-21swapper/112:12:031
898999130,2cyclictest0-21swapper/110:46:241
898999130,2cyclictest0-21swapper/108:20:061
898999130,12cyclictest0-21swapper/112:29:441
898999130,12cyclictest0-21swapper/109:05:161
898999130,12cyclictest0-21swapper/109:01:031
898899139,3cyclictest0-21swapper/008:46:020
8988991310,2cyclictest25439-21diskmemload12:24:170
8988991310,2cyclictest19725-21ssh11:50:120
8988991310,2cyclictest0-21swapper/012:25:170
8988991310,2cyclictest0-21swapper/011:57:570
8988991310,2cyclictest0-21swapper/011:43:170
8988991310,2cyclictest0-21swapper/011:00:190
8988991310,2cyclictest0-21swapper/008:10:110
8988991310,2cyclictest0-21swapper/007:45:170
898899130,2cyclictest19577-21apt-get08:55:120
898899130,2cyclictest0-21swapper/012:13:190
898899130,2cyclictest0-21swapper/012:04:380
898899130,12cyclictest0-21swapper/008:35:160
899099129,2cyclictest0-21swapper/209:10:062
899099128,2cyclictest0-21swapper/212:10:072
899099122,7cyclictest0-21swapper/207:16:022
899099120,2cyclictest15012-21ssh10:05:022
898999129,2cyclictest0-21swapper/108:15:171
898999127,3cyclictest0-21swapper/107:10:131
898999122,7cyclictest0-21swapper/107:40:001
898999121,9cyclictest12018-21ssh12:15:141
898999121,9cyclictest11276-21aten2.4-expect07:15:131
898999121,9cyclictest0-21swapper/108:55:401
898999121,9cyclictest0-21swapper/108:25:111
898999121,3cyclictest17308-21munin-node1
898999120,2cyclictest0-21swapper/111:16:551
898999120,2cyclictest0-21swapper/109:25:321
898999120,2cyclictest0-21swapper/107:20:181
898999120,11cyclictest207150irq/24-eth111:05:111
898999120,11cyclictest0-21swapper/109:46:031
898999120,11cyclictest0-21swapper/109:15:331
898999120,11cyclictest0-21swapper/108:40:171
898999120,11cyclictest0-21swapper/108:10:101
898899129,2cyclictest0-21swapper/011:21:330
898899129,2cyclictest0-21swapper/011:15:200
898899129,2cyclictest0-21swapper/010:21:120
898899129,2cyclictest0-21swapper/009:56:500
898899122,5cyclictest0-21swapper/008:00:010
898899121,9cyclictest16093-21ssh10:05:190
898899120,2cyclictest25439-21diskmemload12:06:200
898899120,2cyclictest0-21swapper/012:35:210
898899120,2cyclictest0-21swapper/012:35:200
898899120,2cyclictest0-21swapper/012:31:000
898899120,2cyclictest0-21swapper/012:15:100
898899120,2cyclictest0-21swapper/011:10:490
898899120,2cyclictest0-21swapper/011:05:100
898899120,2cyclictest0-21swapper/010:55:590
898899120,2cyclictest0-21swapper/010:30:200
898899120,2cyclictest0-21swapper/010:15:080
898899120,2cyclictest0-21swapper/010:00:010
898899120,2cyclictest0-21swapper/009:26:270
898899120,11cyclictest0-21swapper/010:45:060
898899120,11cyclictest0-21swapper/010:10:150
898899120,11cyclictest0-21swapper/009:10:490
898899120,11cyclictest0-21swapper/007:36:010
899199118,2cyclictest0-21swapper/308:15:053
898999118,2cyclictest0-21swapper/107:55:181
898999110,9cyclictest0-21swapper/108:01:011
898899118,2cyclictest0-21swapper/007:30:130
898899111,8cyclictest11213-21apt-get07:15:120
898899111,5cyclictest0-21swapper/007:20:000
898899110,2cyclictest0-21swapper/008:23:590
898899110,2cyclictest0-21swapper/008:16:000
898999101,3cyclictest0-21swapper/108:30:171
898999100,8cyclictest0-21swapper/107:25:291
898899107,2cyclictest0-21swapper/008:05:150
898899106,2cyclictest7608-21aten2.4-expect08:25:130
898899101,5cyclictest0-21swapper/007:55:000
898899100,9cyclictest0-21swapper/007:25:010
898899100,9cyclictest0-21swapper/007:14:110
898899100,8cyclictest0-21swapper/008:35:010
898899100,2cyclictest0-21swapper/009:00:130
89899994,3cyclictest31730-21aten2.4-expect08:05:141
89899994,3cyclictest12149-21interrupts08:35:151
89889996,2cyclictest0-21swapper/008:42:380
89889996,2cyclictest0-21swapper/008:00:590
89889990,7cyclictest23704-21aten2.4-expect09:05:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional