Returning EPROBE_DEFER after probing a bus may result in an infinite probe loop if the EPROBE_DEFER error is never resolved. There are two mutually-exclusive scenarios (that can both occur in the same system). First, the PCS can be attached to our own MDIO bus: MAC | +->MDIO | +->PCS +->PHY (etc) In this scenario, we have to probe the MDIO bus before we can look up the PCS, since otherwise the PCS will always be missing when we look for it. But if we do things in the right order then we can't get EPROBE_DEFER, and so there's no risk of a probe loop. Second, the PCS can be attached to some other MDIO bus: MAC MDIO | | +->MDIO +->PCS | +->PHY (etc) In this scenario, the MDIO bus might not be present for whatever reason (module not loaded, error in probe, etc.) and we have the possibility of an EPROBE_DEFER error. If that happens, we will end up in a probe loop because the PHY on our own MDIO bus incremented deferred_trigger_count when it probed successfully: deferred_probe_work_func() driver_probe_device(MAC) axienet_probe(MAC) mdiobus_register(MDIO) device_add(PHY) (probe successful) driver_bound(PHY) driver_deferred_probe_trigger() return -EPROBE_DEFER driver_deferred_probe_add(MAC) // deferred_trigger_count changed, so... driver_deferred_probe_trigger() As I see it, this problem could be solved in the following four ways: - Modify the driver core to detect and mitigate this sort of scenario (NACKed by Greg). - Split the driver into MAC and MDIO parts (this commit). - Modify phylink to allow connecting a PCS after phylink_create but before phylink_start. This is tricky because the PCS can affect the supported phy interfaces, and phy interfaces are validated in phylink_create. - Defer phylink_create to ndo_open. This means that all the netdev/ethtool ops that use phylink now need to check ip the netdev is open and fall back to some other implementation. I don't think we can just return -EINVAL or whatever because using ethtool on a down device has historically worked. I am wary of breaking userspace because some tool assumes it can get_ksettings while the netdev is down. Aside from the first option, the second one (this commit) has the best UX. With the latter two, you could have a netdev that never comes up and the user may not have very good insight as to why. For example, it may not be obvious that the user should try to bring the netdev up again after the PCS is probed. By waiting to create the netdev until after we successfully probe the PCS we show up in devices_deferred and the netdev can be brought up as usual. Per the second bullet point above, split the MAC and MDIO functionality into separate auxiliary devices. If the MAC fails with EPROBE_DEFER, then the MDIO bus will remain bound, preventing a probe loop. Fixes: 1a02556086fc ("net: axienet: Properly handle PCS/PMA PHY for 1000BaseX mode") Signed-off-by: Sean Anderson --- Changes in v3: - Rework to use a separate axienet_common structure, as netdevs cannot be reused once registered. - Use ida_alloc for aux id Changes in v2: - Fix building as a module - Expand commit message with much more info on the problem and possible solutions drivers/net/ethernet/xilinx/Kconfig | 1 + drivers/net/ethernet/xilinx/xilinx_axienet.h | 10 +- .../net/ethernet/xilinx/xilinx_axienet_main.c | 168 ++++++++++++++---- .../net/ethernet/xilinx/xilinx_axienet_mdio.c | 59 +++--- 4 files changed, 169 insertions(+), 69 deletions(-) diff --git a/drivers/net/ethernet/xilinx/Kconfig b/drivers/net/ethernet/xilinx/Kconfig index 7502214cc7d5..3b940d2d3115 100644 --- a/drivers/net/ethernet/xilinx/Kconfig +++ b/drivers/net/ethernet/xilinx/Kconfig @@ -27,6 +27,7 @@ config XILINX_AXI_EMAC tristate "Xilinx 10/100/1000 AXI Ethernet support" depends on HAS_IOMEM depends on XILINX_DMA + select AUXILIARY_BUS select PHYLINK select DIMLIB help diff --git a/drivers/net/ethernet/xilinx/xilinx_axienet.h b/drivers/net/ethernet/xilinx/xilinx_axienet.h index d7215dd92ce9..69665c7f264a 100644 --- a/drivers/net/ethernet/xilinx/xilinx_axienet.h +++ b/drivers/net/ethernet/xilinx/xilinx_axienet.h @@ -470,6 +470,7 @@ struct skbuf_dma_descriptor { /** * struct axienet_common - axienet private common data * @pdev: Pointer to common platform device structure + * @mac: Pointer to MAC (netdev parent) device structure * @axi_clk: AXI4-Lite bus clock * @reset_lock: Lock held while resetting the device to prevent register access * @mii_bus: Pointer to MII bus structure @@ -479,11 +480,12 @@ struct skbuf_dma_descriptor { */ struct axienet_common { struct platform_device *pdev; + struct auxiliary_device mac; struct clk *axi_clk; struct mutex reset_lock; - struct mii_bus *mii_bus; + struct auxiliary_device mii_bus; u8 mii_clk_div; void __iomem *regs; @@ -493,7 +495,7 @@ struct axienet_common { /** * struct axienet_local - axienet private per device data * @ndev: Pointer for net_device to which it will be attached. - * @dev: Pointer to device structure + * @dev: Pointer to parent device structure for DMA access * @phylink: Pointer to phylink instance * @phylink_config: phylink configuration settings * @pcs_phy: Reference to PCS/PMA PHY if used @@ -752,8 +754,6 @@ static inline void axienet_dma_out_addr(struct axienet_local *lp, off_t reg, #endif /* CONFIG_64BIT */ -/* Function prototypes visible in xilinx_axienet_mdio.c for other files */ -int axienet_mdio_setup(struct axienet_common *lp); -void axienet_mdio_teardown(struct axienet_common *lp); +extern struct auxiliary_driver xilinx_axienet_mdio; #endif /* XILINX_AXI_ENET_H */ diff --git a/drivers/net/ethernet/xilinx/xilinx_axienet_main.c b/drivers/net/ethernet/xilinx/xilinx_axienet_main.c index f235ef15187c..23e5c8090d45 100644 --- a/drivers/net/ethernet/xilinx/xilinx_axienet_main.c +++ b/drivers/net/ethernet/xilinx/xilinx_axienet_main.c @@ -22,6 +22,7 @@ * - Add support for extended VLAN support. */ +#include #include #include #include @@ -1907,8 +1908,11 @@ static const struct net_device_ops axienet_netdev_dmaengine_ops = { static void axienet_ethtools_get_drvinfo(struct net_device *ndev, struct ethtool_drvinfo *ed) { + struct axienet_local *lp = netdev_priv(ndev); + strscpy(ed->driver, DRIVER_NAME, sizeof(ed->driver)); strscpy(ed->version, DRIVER_VERSION, sizeof(ed->version)); + strscpy(ed->bus_info, dev_name(lp->dev), sizeof(ed->bus_info)); } /** @@ -2749,10 +2753,12 @@ static void axienet_disable_misc(void *clocks) clk_bulk_disable_unprepare(XAE_NUM_MISC_CLOCKS, clocks); } -static int axienet_mac_probe(struct axienet_common *cp) +static int axienet_mac_probe(struct auxiliary_device *auxdev, + const struct auxiliary_device_id *id) { + struct axienet_common *cp = auxdev->dev.platform_data; struct platform_device *pdev = cp->pdev; - struct device *dev = &pdev->dev; + struct device *dev = &auxdev->dev; struct axienet_local *lp; struct net_device *ndev; struct device_node *np; @@ -2765,7 +2771,7 @@ static int axienet_mac_probe(struct axienet_common *cp) if (!ndev) return -ENOMEM; - platform_set_drvdata(pdev, ndev); + auxiliary_set_drvdata(auxdev, ndev); SET_NETDEV_DEV(ndev, dev); ndev->features = NETIF_F_SG; @@ -2777,7 +2783,7 @@ static int axienet_mac_probe(struct axienet_common *cp) lp = netdev_priv(ndev); lp->ndev = ndev; - lp->dev = dev; + lp->dev = &pdev->dev; lp->cp = cp; lp->regs = cp->regs; lp->options = XAE_OPTION_DEFAULTS; @@ -2909,8 +2915,11 @@ static int axienet_mac_probe(struct axienet_common *cp) of_node_put(np); lp->eth_irq = platform_get_irq_optional(pdev, 0); } else { + struct resource *dmares; + /* Check for these resources directly on the Ethernet node. */ - lp->dma_regs = devm_platform_get_and_ioremap_resource(pdev, 1, NULL); + dmares = platform_get_resource(pdev, IORESOURCE_MEM, 1); + lp->dma_regs = devm_ioremap_resource(dev, dmares); lp->rx_irq = platform_get_irq(pdev, 1); lp->tx_irq = platform_get_irq(pdev, 0); lp->eth_irq = platform_get_irq_optional(pdev, 2); @@ -2925,7 +2934,9 @@ static int axienet_mac_probe(struct axienet_common *cp) } /* Reset core now that clocks are enabled, prior to accessing MDIO */ + axienet_lock_mii(lp); ret = __axienet_device_reset(lp); + axienet_unlock_mii(lp); if (ret) return ret; @@ -2957,7 +2968,8 @@ static int axienet_mac_probe(struct axienet_common *cp) return -EINVAL; } - ret = dma_set_mask_and_coherent(dev, DMA_BIT_MASK(addr_width)); + ret = dma_set_mask_and_coherent(lp->dev, + DMA_BIT_MASK(addr_width)); if (ret) { dev_err(dev, "No suitable DMA available\n"); return ret; @@ -3055,7 +3067,7 @@ static int axienet_mac_probe(struct axienet_common *cp) lp->phylink_config.supported_interfaces); } - lp->phylink = phylink_create(&lp->phylink_config, dev->fwnode, + lp->phylink = phylink_create(&lp->phylink_config, dev_fwnode(dev), lp->phy_mode, &axienet_phylink_ops); if (IS_ERR(lp->phylink)) { @@ -3080,9 +3092,9 @@ static int axienet_mac_probe(struct axienet_common *cp) return ret; } -static void axienet_mac_remove(struct platform_device *pdev) +static void axienet_mac_remove(struct auxiliary_device *auxdev) { - struct net_device *ndev = platform_get_drvdata(pdev); + struct net_device *ndev = auxiliary_get_drvdata(auxdev); struct axienet_local *lp = netdev_priv(ndev); unregister_netdev(ndev); @@ -3091,9 +3103,9 @@ static void axienet_mac_remove(struct platform_device *pdev) put_device(&lp->pcs_phy->dev); } -static void axienet_mac_shutdown(struct platform_device *pdev) +static void axienet_mac_shutdown(struct auxiliary_device *auxdev) { - struct net_device *ndev = platform_get_drvdata(pdev); + struct net_device *ndev = auxiliary_get_drvdata(auxdev); rtnl_lock(); netif_device_detach(ndev); @@ -3139,12 +3151,78 @@ static int axienet_resume(struct device *dev) static DEFINE_SIMPLE_DEV_PM_OPS(axienet_pm_ops, axienet_suspend, axienet_resume); +static const struct auxiliary_device_id xilinx_axienet_mac_id_table[] = { + { .name = KBUILD_MODNAME ".mac", }, + { }, +}; +MODULE_DEVICE_TABLE(auxiliary, xilinx_axienet_mac_id_table); + +static struct auxiliary_driver xilinx_axienet_mac = { + .name = "mac", + .id_table = xilinx_axienet_mac_id_table, + .probe = axienet_mac_probe, + .remove = axienet_mac_remove, + .shutdown = axienet_mac_shutdown, + .driver = { + .pm = &axienet_pm_ops, + }, +}; + +static DEFINE_IDA(axienet_id); + +static void axienet_id_free(void *data) +{ + int id = (intptr_t)data; + + ida_free(&axienet_id, id); +} + +static void auxenet_aux_release(struct device *dev) { } + +static void axienet_aux_destroy(void *data) +{ + struct auxiliary_device *auxdev = data; + + auxiliary_device_delete(auxdev); + auxiliary_device_uninit(auxdev); + fwnode_handle_put(auxdev->dev.fwnode); +} + +static int axienet_aux_create(struct axienet_common *cp, + struct auxiliary_device *auxdev, const char *name, + int id, struct fwnode_handle *fwnode) +{ + struct device *dev = &cp->pdev->dev; + int ret; + + auxdev->name = name; + auxdev->id = id; + auxdev->dev.parent = dev; + auxdev->dev.platform_data = cp; + auxdev->dev.release = auxenet_aux_release; + device_set_node(&auxdev->dev, fwnode); + ret = auxiliary_device_init(auxdev); + if (ret) { + fwnode_handle_put(fwnode); + return ret; + } + + ret = auxiliary_device_add(auxdev); + if (ret) { + fwnode_handle_put(fwnode); + auxiliary_device_uninit(auxdev); + return ret; + } + + return devm_add_action_or_reset(dev, axienet_aux_destroy, auxdev); +} + static int axienet_probe(struct platform_device *pdev) { struct device *dev = &pdev->dev; struct axienet_common *cp; struct resource *ethres; - int ret; + int ret, id; cp = devm_kzalloc(dev, sizeof(*cp), GFP_KERNEL); if (!cp) @@ -3170,33 +3248,31 @@ static int axienet_probe(struct platform_device *pdev) return PTR_ERR(cp->regs); cp->regs_start = ethres->start; - ret = axienet_mdio_setup(cp); - if (ret) - dev_warn(dev, "error registering MDIO bus: %d\n", ret); + id = ida_alloc(&axienet_id, GFP_KERNEL); + if (id < 0) + return dev_err_probe(dev, id, "could not allocate id\n"); - ret = axienet_mac_probe(cp); - if (!ret) - return 0; + ret = devm_add_action_or_reset(dev, axienet_id_free, + (void *)(intptr_t)id); + if (ret) + return dev_err_probe(dev, ret, + "could not register id free action\n"); - if (cp->mii_bus) - axienet_mdio_teardown(cp); - return ret; -} + ret = axienet_aux_create(cp, &cp->mii_bus, "mdio", id, + device_get_named_child_node(dev, "mdio")); + if (ret) + return dev_err_probe(dev, ret, "could not create mdio bus\n"); -static void axienet_remove(struct platform_device *pdev) -{ - struct net_device *ndev = platform_get_drvdata(pdev); - struct axienet_local *lp = netdev_priv(ndev); + ret = axienet_aux_create(cp, &cp->mac, "mac", id, + fwnode_handle_get(dev_fwnode(dev))); + if (ret) + return dev_err_probe(dev, ret, "could not create MAC\n"); - axienet_mac_remove(pdev); - if (lp->mii_bus) - axienet_mdio_teardown(lp->cp); + return 0; } static struct platform_driver axienet_driver = { .probe = axienet_probe, - .remove = axienet_remove, - .shutdown = axienet_mac_shutdown, .driver = { .name = "xilinx_axienet", .pm = &axienet_pm_ops, @@ -3204,7 +3280,35 @@ static struct platform_driver axienet_driver = { }, }; -module_platform_driver(axienet_driver); +static int __init axienet_init(void) +{ + int ret; + + ret = auxiliary_driver_register(&xilinx_axienet_mdio); + if (ret) + return ret; + + ret = auxiliary_driver_register(&xilinx_axienet_mac); + if (ret) + goto unregister_mdio; + + ret = platform_driver_register(&axienet_driver); + if (ret) { + auxiliary_driver_unregister(&xilinx_axienet_mac); +unregister_mdio: + auxiliary_driver_unregister(&xilinx_axienet_mdio); + } + return ret; +} +module_init(axienet_init); + +static void __exit axienet_exit(void) +{ + platform_driver_register(&axienet_driver); + auxiliary_driver_unregister(&xilinx_axienet_mac); + auxiliary_driver_unregister(&xilinx_axienet_mdio); +} +module_exit(axienet_exit); MODULE_DESCRIPTION("Xilinx Axi Ethernet driver"); MODULE_AUTHOR("Xilinx"); diff --git a/drivers/net/ethernet/xilinx/xilinx_axienet_mdio.c b/drivers/net/ethernet/xilinx/xilinx_axienet_mdio.c index d428ce6da639..cc8a2a70271b 100644 --- a/drivers/net/ethernet/xilinx/xilinx_axienet_mdio.c +++ b/drivers/net/ethernet/xilinx/xilinx_axienet_mdio.c @@ -9,10 +9,10 @@ * Copyright (c) 2010 - 2012 Xilinx, Inc. All rights reserved. */ +#include #include #include #include -#include #include #include @@ -271,19 +271,10 @@ static int axienet_mdio_enable(struct mii_bus *bus, struct device_node *np) return ret; } -/** - * axienet_mdio_setup - MDIO setup function - * @lp: Pointer to axienet common data structure. - * - * Return: 0 on success, -ETIMEDOUT on a timeout, -EOVERFLOW on a clock - * divisor overflow, -ENOMEM when mdiobus_alloc (to allocate - * memory for mii bus structure) fails. - * - * Sets up the MDIO interface by initializing the MDIO clock. - * Register the MDIO interface. - **/ -int axienet_mdio_setup(struct axienet_common *lp) +static int axienet_mdio_probe(struct auxiliary_device *auxdev, + const struct auxiliary_device_id *id) { + struct axienet_common *lp = auxdev->dev.platform_data; struct device_node *mdio_node; struct mii_bus *bus; int ret; @@ -299,36 +290,40 @@ int axienet_mdio_setup(struct axienet_common *lp) bus->name = "Xilinx Axi Ethernet MDIO"; bus->read = axienet_mdio_read; bus->write = axienet_mdio_write; - bus->parent = &lp->pdev->dev; - lp->mii_bus = bus; + bus->parent = &auxdev->dev; + auxiliary_set_drvdata(auxdev, bus); - mdio_node = of_get_child_by_name(lp->pdev->dev.of_node, "mdio"); - scoped_guard(mutex, &lp->reset_lock) - ret = axienet_mdio_enable(bus, mdio_node); + mdio_node = dev_of_node(&auxdev->dev); + ret = axienet_mdio_enable(bus, mdio_node); if (ret < 0) goto unregister; ret = of_mdiobus_register(bus, mdio_node); - of_node_put(mdio_node); scoped_guard(mutex, &lp->reset_lock) axienet_mdio_mdc_disable(lp); - if (ret) { + if (ret) unregister: mdiobus_free(bus); - lp->mii_bus = NULL; - } return ret; } -/** - * axienet_mdio_teardown - MDIO remove function - * @lp: Pointer to axienet common data structure. - * - * Unregisters the MDIO and frees any associate memory for mii bus. - */ -void axienet_mdio_teardown(struct axienet_common *lp) +static void axienet_mdio_remove(struct auxiliary_device *auxdev) { - mdiobus_unregister(lp->mii_bus); - mdiobus_free(lp->mii_bus); - lp->mii_bus = NULL; + struct mii_bus *mii_bus = auxiliary_get_drvdata(auxdev); + + mdiobus_unregister(mii_bus); + mdiobus_free(mii_bus); } + +static const struct auxiliary_device_id xilinx_axienet_mdio_id_table[] = { + { .name = KBUILD_MODNAME ".mdio", }, + { }, +}; +MODULE_DEVICE_TABLE(auxiliary, xilinx_axienet_mdio_id_table); + +struct auxiliary_driver xilinx_axienet_mdio = { + .name = "mdio", + .id_table = xilinx_axienet_mdio_id_table, + .probe = axienet_mdio_probe, + .remove = axienet_mdio_remove, +}; -- 2.35.1.1320.gc452695387.dirty