You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 07:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Sep 05, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10043993318,14cyclictest0-21swapper/121:51:281
10043992721,5cyclictest8459-21ssh00:10:321
10043992721,5cyclictest8459-21ssh00:10:321
10043992625,1cyclictest0-21swapper/122:01:351
1004399260,25cyclictest0-21swapper/122:28:421
1004399260,1cyclictest2821-21/usr/sbin/munin23:36:291
1004399260,1cyclictest0-21swapper/123:15:031
1004399260,1cyclictest0-21swapper/122:22:501
1004899250,24cyclictest3690-21diskmemload23:41:363
1004899250,24cyclictest18841-21sh20:35:003
1004499250,2cyclictest832-21apache200:00:002
1004499250,24cyclictest6984-21ssh23:10:052
10043992523,2cyclictest0-21swapper/123:23:081
10043992522,2cyclictest10293-21sh22:14:191
10043992520,4cyclictest0-21swapper/121:21:291
1004399250,24cyclictest3690-21diskmemload22:55:151
1004399250,24cyclictest1837-21ssh00:33:521
1004399250,24cyclictest0-21swapper/122:53:551
1004399250,24cyclictest0-21swapper/122:32:431
1004399250,24cyclictest0-21swapper/121:39:561
1004399250,21cyclictest11623-21apt-get21:46:271
1004399250,21cyclictest11623-21apt-get21:46:271
1004399250,21cyclictest0-21swapper/100:07:241
1004399250,0cyclictest0-21swapper/121:15:161
1003899250,24cyclictest606-21dbus-daemon21:05:010
1003899250,24cyclictest2294-21ssh23:06:160
10048992423,0cyclictest0-21swapper/321:22:253
10048992422,1cyclictest15396-21ssh23:16:473
10048992422,1cyclictest0-21swapper/322:59:003
1004899241,22cyclictest0-21swapper/300:20:013
1004899240,23cyclictest3690-21diskmemload21:58:263
1004899240,23cyclictest31024-21apt-get00:31:303
1004899240,23cyclictest0-21swapper/323:32:303
1004899240,23cyclictest0-21swapper/322:46:283
1004899240,1cyclictest7085-21grep23:40:013
1004899240,1cyclictest3690-21diskmemload22:50:083
1004899240,1cyclictest14528-21sh21:48:083
1004899240,1cyclictest14528-21sh21:48:083
10044992423,1cyclictest19850-21ssh21:23:272
10044992422,1cyclictest0-21swapper/223:50:562
10044992420,4cyclictest0-21swapper/223:08:482
1004499240,24cyclictest0-21swapper/221:47:102
1004499240,24cyclictest0-21swapper/221:47:102
1004499240,23cyclictest5860-21perf22:40:012
1004499240,23cyclictest3690-21diskmemload21:39:202
10043992422,2cyclictest0-21swapper/123:33:291
10043992422,2cyclictest0-21swapper/122:19:331
10043992422,1cyclictest0-21swapper/122:48:001
10043992421,2cyclictest0-21swapper/100:19:381
10043992420,4cyclictest0-21swapper/120:51:291
1004399240,23cyclictest0-21swapper/123:54:531
1004399240,23cyclictest0-21swapper/121:10:511
1004399240,20cyclictest0-21swapper/121:30:361
1004399240,0cyclictest0-21swapper/121:56:591
10038992421,2cyclictest28528-21ssh22:31:280
1003899240,23cyclictest0-21swapper/023:37:110
1003899240,1cyclictest0-21swapper/023:20:210
10048992323,0cyclictest0-21swapper/323:59:003
10048992323,0cyclictest0-21swapper/322:39:423
10048992321,1cyclictest605-21avahi-daemon22:35:003
10048992321,1cyclictest15971-21ssh23:46:393
10048992320,2cyclictest24034-21sh00:24:463
10048992320,2cyclictest18478-21sh23:20:503
1004899230,2cyclictest24628-21diskmemload00:25:123
1004899230,23cyclictest0-21swapper/321:51:093
1004899230,23cyclictest0-21swapper/300:05:523
1004899230,22cyclictest3690-21diskmemload22:11:203
1004899230,22cyclictest22582-21sh23:53:183
1004899230,22cyclictest21513-21ssh21:25:393
1004899230,22cyclictest2144-21ssh23:06:053
1004899230,22cyclictest0-21swapper/323:26:393
1004899230,22cyclictest0-21swapper/322:05:513
1004899230,0cyclictest0-21swapper/323:14:163
1004899230,0cyclictest0-21swapper/321:16:113
10044992323,0cyclictest0-21swapper/223:41:462
10044992323,0cyclictest0-21swapper/222:02:092
10044992322,0cyclictest0-21swapper/221:55:032
10044992321,1cyclictest0-21swapper/223:29:562
10044992320,2cyclictest3690-21diskmemload22:56:352
10044992320,2cyclictest21895-21date22:25:002
10044992320,2cyclictest16195-21ssh21:50:112
10044992320,2cyclictest13000-21ssh23:15:582
1004499230,3cyclictest0-21swapper/222:34:002
1004499230,23cyclictest0-21swapper/221:41:132
1004499230,23cyclictest0-21swapper/221:33:412
1004499230,23cyclictest0-21swapper/200:20:172
1004499230,22cyclictest566-21sh22:05:582
1004499230,22cyclictest3422-21ssh00:06:112
1004499230,22cyclictest30545-21sh23:31:342
1004499230,0cyclictest0-21swapper/223:01:122
1004499230,0cyclictest0-21swapper/222:16:142
10043992323,0cyclictest3690-21diskmemload23:26:001
10043992320,3cyclictest0-21swapper/123:41:101
10043992320,3cyclictest0-21swapper/100:27:131
10043992318,4cyclictest0-21swapper/122:41:281
10043992318,4cyclictest0-21swapper/120:16:301
1004399230,23cyclictest0-21swapper/123:59:571
1004399230,23cyclictest0-21swapper/123:06:121
1004399230,23cyclictest0-21swapper/123:01:381
1004399230,23cyclictest0-21swapper/121:26:081
1004399230,23cyclictest0-21swapper/100:00:521
1004399230,0cyclictest0-21swapper/123:48:041
1004399230,0cyclictest0-21swapper/122:07:491
10038992323,0cyclictest0-21swapper/021:41:020
10038992323,0cyclictest0-21swapper/021:12:060
10038992322,1cyclictest3690-21diskmemload21:16:400
10038992321,1cyclictest0-21swapper/023:51:330
10038992321,1cyclictest0-21swapper/022:55:020
10038992321,1cyclictest0-21swapper/022:47:030
10038992321,1cyclictest0-21swapper/019:55:000
10038992321,1cyclictest0-21swapper/000:12:030
10038992321,1cyclictest0-21swapper/000:12:030
10038992321,1cyclictest0-21swapper/000:01:340
10038992320,2cyclictest29291-21ssh23:30:450
10038992320,2cyclictest13256-21ssh23:45:120
1003899230,23cyclictest3690-21diskmemload21:58:110
1003899230,23cyclictest0-21swapper/023:14:020
1003899230,23cyclictest0-21swapper/022:50:400
1003899230,22cyclictest8035-21ssh23:40:270
1003899230,22cyclictest7117-21ssh22:41:270
1003899230,22cyclictest62550irq/127-eno122:15:570
1003899230,22cyclictest4690-21ssh22:09:160
1003899230,22cyclictest3690-21diskmemload23:57:390
1003899230,22cyclictest27645-21ssh21:31:290
1003899230,22cyclictest27415-21ssh23:28:270
1003899230,22cyclictest25024-21ssh22:26:470
1003899230,22cyclictest24809-21rm21:27:540
1003899230,22cyclictest17421-21ssh00:18:100
1003899230,22cyclictest14606-21ssh21:48:150
1003899230,22cyclictest14606-21ssh21:48:150
1003899230,22cyclictest13138-21ssh23:16:090
1003899230,22cyclictest0-21swapper/000:31:300
1003899230,0cyclictest0-21swapper/023:00:370
1003899230,0cyclictest0-21swapper/021:37:430
1003899230,0cyclictest0-21swapper/000:26:540
1003899230,0cyclictest0-21swapper/000:23:000
10048992222,0cyclictest0-21swapper/322:16:583
10048992221,1cyclictest23093-21apt-get22:26:303
10048992221,1cyclictest0-21swapper/321:31:013
10048992220,1cyclictest21641-21apt-get20:41:283
1004899220,21cyclictest8587-21ssh00:10:423
1004899220,21cyclictest8587-21ssh00:10:423
1004899220,21cyclictest6465-21ssh22:40:403
1004899220,21cyclictest4088-21ssh21:10:123
1004899220,21cyclictest32026-21ssh23:02:493
1004899220,21cyclictest31972-21apt-get19:56:283
1004899220,21cyclictest2850-21rm21:37:133
1004899220,21cyclictest17581-21apt-get19:26:283
1004899220,21cyclictest0-21swapper/319:31:283
1004899220,21cyclictest0-21swapper/300:37:353
1004899220,21cyclictest0-21swapper/300:00:133
1004899220,1cyclictest30240-21sh22:02:173
1004899220,1cyclictest0-21swapper/321:40:163
10044992222,0cyclictest0-21swapper/200:00:072
10044992220,1cyclictest4006-21ssh21:10:062
10044992220,1cyclictest2413-21ssh23:35:432
10044992219,2cyclictest17222-21perf19:25:012
1004499220,2cyclictest9085-21ssh00:11:292
1004499220,2cyclictest9085-21ssh00:11:292
1004499220,22cyclictest3690-21diskmemload23:20:012
1004499220,22cyclictest11180-21ssh21:16:262
1004499220,21cyclictest3802-21ssh00:36:122
1004499220,21cyclictest3690-21diskmemload22:40:302
1004499220,21cyclictest30384-21ssh00:30:432
1004499220,21cyclictest26430-21apt-get20:51:292
1004499220,21cyclictest15039-21sh22:47:322
1004499220,21cyclictest0-21swapper/221:25:572
1004499220,21cyclictest0-21swapper/220:26:282
1004499220,1cyclictest8815-21ssh22:12:162
1004499220,1cyclictest3690-21diskmemload00:25:132
1004499220,1cyclictest0-21swapper/200:15:112
10043992220,2cyclictest0-21swapper/123:10:361
10043992220,1cyclictest931-21diskmemload22:35:411
1004399220,21cyclictest31246-21systemctl21:00:001
1004399220,21cyclictest0-21swapper/100:36:181
1004399220,1cyclictest22013-21munin-run19:35:011
1004399220,0cyclictest0-21swapper/121:42:101
10038992221,1cyclictest0-21swapper/021:51:230
10038992220,1cyclictest3690-21diskmemload22:12:110
10038992220,1cyclictest1229-21sh22:36:040
10038992220,1cyclictest11622-21cron20:20:010
1003899220,21cyclictest0-21swapper/020:31:290
1003899220,21cyclictest0-21swapper/019:16:270
1003899220,1cyclictest606-21dbus-daemon20:25:010
1003899220,0cyclictest0-21swapper/000:06:350
10048992120,1cyclictest7215-21apt-get20:11:283
10048992119,1cyclictest24379-21sh19:40:013
1004899210,1cyclictest21263-21latency_hist20:40:003
1004899210,0cyclictest10375-21apt-get19:11:283
10044992119,1cyclictest26813-21perf19:45:002
1004499210,21cyclictest19071-21strings22:51:342
1004499210,21cyclictest0-21swapper/222:25:072
1004499210,1cyclictest12037-21apt-get20:21:272
10043992121,0cyclictest0-21swapper/120:31:291
10043992118,2cyclictest21240-21sh20:40:001
10043992118,2cyclictest12396-21cron19:15:001
1004399210,20cyclictest9228-21cron20:15:011
1004399210,20cyclictest0-21swapper/120:41:281
1004399210,0cyclictest0-21swapper/120:01:291
1004399210,0cyclictest0-21swapper/119:36:271
10038992121,0cyclictest0-21swapper/000:35:020
10038992119,1cyclictest0-21swapper/022:00:330
1003899210,21cyclictest0-21swapper/021:21:330
1003899210,21cyclictest0-21swapper/019:11:280
1003899210,20cyclictest0-21swapper/019:41:280
1004899200,0cyclictest0-21swapper/320:55:023
1004899200,0cyclictest0-21swapper/320:26:283
10044992020,0cyclictest0-21swapper/220:31:292
10044992020,0cyclictest0-21swapper/219:26:292
10043992020,0cyclictest0-21swapper/120:26:281
10043992020,0cyclictest0-21swapper/119:46:281
10043992020,0cyclictest0-21swapper/119:21:301
10043992015,4cyclictest14834-21idleruntime-cro19:20:001
10043992014,5cyclictest0-21swapper/119:45:001
10038992020,0cyclictest0-21swapper/020:41:290
10038992020,0cyclictest0-21swapper/020:06:280
10038992020,0cyclictest0-21swapper/019:26:290
10038992018,1cyclictest31243-21turbostat.cron21:00:000
10048991919,0cyclictest24037-21apt-get20:46:293
10048991919,0cyclictest0-21swapper/319:46:283
10044991919,0cyclictest0-21swapper/221:06:282
10044991917,1cyclictest31639-21apt-get21:01:282
10043991919,0cyclictest0-21swapper/120:46:291
10043991919,0cyclictest0-21swapper/120:05:021
10043991919,0cyclictest0-21swapper/119:26:291
10043991917,1cyclictest3674-21cron21:10:011
10038991919,0cyclictest19977-21apt-get19:31:280
10038991919,0cyclictest0-21swapper/020:46:290
10038991919,0cyclictest0-21swapper/020:36:270
10038991917,1cyclictest606-21dbus-daemon19:40:010
1003899190,1cyclictest16451-21perf20:30:000
10048991818,0cyclictest0-21swapper/319:41:283
10044991818,0cyclictest0-21swapper/219:36:272
10044991818,0cyclictest0-21swapper/219:16:272
1004499180,17cyclictest0-21swapper/220:11:282
1004399180,3cyclictest14039-21cron20:25:011
1003899180,17cyclictest0-21swapper/020:01:280
10044991715,1cyclictest27181-21apt-get19:46:282
10038991714,2cyclictest8219-21cut20:11:330
10048991616,0cyclictest4055-21apt-get20:05:023
10048991616,0cyclictest0-21swapper/321:06:283
10048991616,0cyclictest0-21swapper/320:51:293
10048991614,1cyclictest1310-21munin-run21:05:013
10044991616,0cyclictest0-21swapper/220:41:292
10044991616,0cyclictest0-21swapper/219:56:282
10044991615,1cyclictest2031-21apt-get20:01:282
1004399160,2cyclictest29761-21cpuspeed_turbos19:51:281
10038991616,0cyclictest0-21swapper/019:46:280
1003899160,1cyclictest3716-21munin-run21:10:010
1003899160,15cyclictest0-21swapper/019:21:340
10048991515,0cyclictest0-21swapper/319:51:283
1004899150,15cyclictest0-21swapper/320:16:303
1004899150,14cyclictest0-21swapper/320:21:303
10044991513,1cyclictest26073-21awk20:50:002
1004499150,1cyclictest0-21swapper/219:10:252
1004899140,14cyclictest0-21swapper/320:00:173
1004899140,14cyclictest0-21swapper/319:20:543
1004899140,0cyclictest0-21swapper/319:15:363
10044991414,0cyclictest0-21swapper/219:51:282
1004499140,14cyclictest0-21swapper/220:55:052
1004499140,14cyclictest0-21swapper/220:36:322
1004499140,14cyclictest0-21swapper/220:15:012
1004499140,14cyclictest0-21swapper/220:05:332
1004499140,14cyclictest0-21swapper/219:30:262
10043991414,0cyclictest0-21swapper/119:56:281
1003899140,14cyclictest0-21swapper/020:50:200
1003899140,0cyclictest0-21swapper/019:56:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional